-- Logs begin at Fri 2022-08-26 05:17:42 UTC, end at Fri 2022-08-26 06:37:36 UTC. -- Aug 26 06:07:30.982264 dv-cinder-853910-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 06:07:30.992193 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 06:07:30.994117 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 06:07:30 2022] *** Aug 26 06:07:30.994117 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 06:07:30.994117 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 06:07:30.994117 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: nodename: dv-cinder-853910-3-iscsi Aug 26 06:07:30.994117 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: machine: x86_64 Aug 26 06:07:30.994117 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: clock source: unix Aug 26 06:07:30.994117 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: pcre jit disabled Aug 26 06:07:30.994117 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: detected number of CPU cores: 4 Aug 26 06:07:30.994117 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: current working directory: / Aug 26 06:07:30.994117 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: detected binary path: /usr/bin/uwsgi-core Aug 26 06:07:30.994821 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: your processes number limit is 47680 Aug 26 06:07:30.994821 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: your memory page size is 4096 bytes Aug 26 06:07:30.994821 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: detected max file descriptor number: 2048 Aug 26 06:07:30.994821 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: lock engine: pthread robust mutexes Aug 26 06:07:30.994821 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: thunder lock: enabled Aug 26 06:07:30.994821 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 06:07:30.994821 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 06:07:31.033645 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: Python main interpreter initialized at 0x55c54ca5a9c0 Aug 26 06:07:31.033645 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: python threads support enabled Aug 26 06:07:31.033645 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: your server socket listen backlog is limited to 100 connections Aug 26 06:07:31.033645 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: your mercy for graceful operations on workers is 90 seconds Aug 26 06:07:31.033985 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 06:07:31.034064 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: *** Operational MODE: preforking *** Aug 26 06:07:31.034306 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: *** uWSGI is running in multiple interpreter mode *** Aug 26 06:07:31.034306 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: spawned uWSGI master process (pid: 106313) Aug 26 06:07:31.034494 dv-cinder-853910-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 06:07:31.035040 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: spawned uWSGI worker 1 (pid: 106314, cores: 1) Aug 26 06:07:31.036425 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: spawned uWSGI worker 2 (pid: 106315, cores: 1) Aug 26 06:07:31.036425 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 06:07:31.696174 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 06:07:31.705656 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 06:07:32.784197 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 06:07:32.784197 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: from cryptography.utils import int_from_bytes Aug 26 06:07:32.784963 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 06:07:32.784963 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: from cryptography.utils import int_from_bytes Aug 26 06:07:32.785115 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 06:07:32.785115 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: from cryptography.utils import int_from_bytes Aug 26 06:07:32.785115 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 06:07:32.785115 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: from cryptography.utils import int_from_bytes Aug 26 06:07:35.288328 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 06:07:35.288904 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 06:07:35.289886 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 06:07:35.290119 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 06:07:35.290484 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 06:07:35.290577 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 06:07:35.290726 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 06:07:35.290867 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.290968 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 06:07:35.291187 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.291285 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 06:07:35.291497 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 06:07:35.291591 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.291808 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.291903 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.292130 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.292283 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.292416 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.292514 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.292737 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.292831 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.293048 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.293144 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.293368 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.293516 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.293611 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.293697 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.293917 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.294010 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.294237 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-3-iscsi {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.294385 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.294549 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.294682 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.294876 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.294973 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.295181 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.295278 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-3-iscsi {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.295492 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.295578 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.295789 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.295888 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.296093 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.296177 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.296395 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.296504 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.296693 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.296900 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.297010 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.297300 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.297616 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.297798 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.297968 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.298129 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.298267 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.298403 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.298533 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.298715 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.298854 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.299049 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.299182 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.299360 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.299478 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.299666 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.299817 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.299980 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.300114 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.300284 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.300419 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.300602 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.300738 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-3-iscsi {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.300906 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.301046 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.301295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-3-iscsi {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.301421 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.301601 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.301717 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.301907 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.302039 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.302215 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.302430 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.302568 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.302725 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.302912 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.303045 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.303228 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.303365 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.303532 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.303666 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.303853 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.303986 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.304155 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.304300 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.304511 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.304655 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.304788 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.304916 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.305077 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.305214 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.305473 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.305609 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.305782 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.305908 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.306099 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.306241 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.306404 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.306538 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.306729 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.306868 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.306993 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.307123 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.307253 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.307377 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.307550 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.307682 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.307855 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.307997 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.308173 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.308312 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.308437 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.308566 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.308696 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.308826 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.308951 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.309080 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.309249 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.309384 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.309549 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.309674 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.309850 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.309986 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.310151 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.310290 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.310451 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.310583 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.310754 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.310884 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.311061 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.311189 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.311360 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.311486 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.311657 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.311789 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.311957 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.312083 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.312259 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.312392 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.312573 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.312706 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.312871 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.313002 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.313184 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.313310 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.313484 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.313619 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.313798 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.313925 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.314096 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.314226 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.314420 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.314650 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.314795 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.314920 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.315048 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.315169 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.315349 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.315488 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.315655 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.315782 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.315956 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.316087 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.316262 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.316405 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.316576 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.316746 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.316878 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.317010 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.317131 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.317270 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.317449 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.317589 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.317718 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.317840 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.317994 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.318132 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.318293 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.318419 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.318589 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.318753 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.318918 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.319043 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.319220 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.319352 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.319520 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.319653 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.319812 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.319948 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.320110 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.320329 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.320520 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.320645 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.320938 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.321074 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.321244 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.321371 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.321549 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.321686 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.321850 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.321985 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.322152 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.322286 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.322451 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.322583 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.322775 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.322910 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.323077 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.323202 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.323381 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.323522 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.323681 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.323813 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.323981 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.324121 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.324281 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.324418 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.324561 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.324770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.324898 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.325029 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.325153 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.325275 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.325449 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.325576 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.325751 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.325877 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.326047 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.326180 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.326348 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.326480 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.326665 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.326793 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.326968 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.327177 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.327304 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.327431 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.327554 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.327674 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.327852 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.327984 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.328151 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.328271 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.328448 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.328572 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.328747 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.328881 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.329046 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.329172 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.329343 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.329469 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.329639 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.329773 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.329933 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.330057 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.330230 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.330369 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.330526 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.330714 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.330839 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.330959 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.331122 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.331255 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.331417 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.331551 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.331713 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.331840 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.332025 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.332150 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.332324 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.332456 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.332624 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.332757 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.332935 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.333062 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.333262 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.333394 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.333588 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.333999 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:07:35.333999 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.334221 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.334221 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.334424 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.334546 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.334707 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.334908 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.335056 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.335188 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.335317 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.335447 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.335575 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.336269 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.336461 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.336654 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.336781 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.336963 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.337165 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.337300 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.337495 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.337622 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.337806 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.337932 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.338116 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.338255 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.338425 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.338558 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.338766 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.338915 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.339073 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.339215 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.339382 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.339516 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.339686 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.339821 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.339996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.340138 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.340308 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.340433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.340616 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.340750 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.340916 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.341050 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.341244 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.341376 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.341564 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.341690 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.341873 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.342010 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.342191 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.342315 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.342509 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.342654 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.342842 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.342964 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.343148 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.343281 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.343454 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.343587 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.343770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.343897 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.344077 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.344209 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.344386 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.344512 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.344697 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.344823 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.345029 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.345156 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.345309 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.345443 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.345616 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.345744 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.345920 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.346046 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.346224 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.346358 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.346534 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.346700 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.346861 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.346986 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.347169 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.347307 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.347479 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.347606 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.347788 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.347921 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.348096 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.348230 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.348403 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.348536 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.348712 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.348846 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.349018 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.349156 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.349323 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.349450 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.349627 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.349759 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.349925 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.350133 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.350289 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.350411 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.350533 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.350672 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.350809 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.350940 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.351101 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.351228 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.351518 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.352187 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.352440 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.352574 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.352843 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.352969 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.353167 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.353295 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.353495 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.353623 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.353801 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.353928 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.354131 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.354264 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.354438 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.354566 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.354772 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.354900 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.355085 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.355238 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.355395 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.355497 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.355698 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.355794 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.356007 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.356114 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.356315 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.356409 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.356620 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.356716 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.356939 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.357043 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.357252 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.357348 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.357551 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.357658 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.357869 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.357979 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.358171 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.358266 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.358474 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.358574 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.358814 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.358910 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.359123 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.359217 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.359432 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.359520 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.359742 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.359837 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.360052 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.360138 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.360386 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.360486 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.360681 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.360775 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.360989 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.361076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.361321 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.361406 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.361648 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.361749 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.361950 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.362035 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.362268 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.362366 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.362581 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.362687 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.362918 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.363004 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.363221 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.363330 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.363526 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.363618 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.363826 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.363912 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.364130 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.364224 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.364435 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.364526 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.364733 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.364821 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.365039 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.365145 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.365343 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.365436 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.365641 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.365725 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.365942 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.366030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.366243 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.366329 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.366556 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.366673 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.366888 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.366977 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.367265 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.367424 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.367664 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.367825 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.367966 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.368155 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.368309 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.368502 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.368618 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.368828 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.368959 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.369156 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.369290 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.369476 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.369607 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.369795 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.369929 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.370109 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.370240 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.370427 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.370555 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.370767 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.370890 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.371082 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.371200 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.371406 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.371491 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.371727 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.371814 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.372050 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.372135 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.372363 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.372448 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.372692 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.372780 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.372999 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.373084 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.373322 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.373432 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.373627 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.373719 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.373940 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.374031 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.374241 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.374341 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.374553 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.374690 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.374916 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.375029 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.375246 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.375376 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.375559 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.375647 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.375876 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.375959 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.376187 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.376280 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.376499 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.376590 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.376808 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.376899 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.377113 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.377206 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.377420 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.377513 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.377727 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.377812 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.378042 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.378129 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.378350 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.378433 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.378697 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.378787 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.379005 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.379092 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.379324 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.379528 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.379630 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.379723 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.379942 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.380030 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.380240 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.380336 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.380550 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.380636 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.380875 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.380962 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.381186 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.381269 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.381497 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.381597 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.381805 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.381891 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.382112 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.382203 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.382416 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.382509 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.382776 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.382929 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.383089 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.383240 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.383495 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.383590 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.383709 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.383831 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.384015 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.384106 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.384325 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.384423 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.384631 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.384719 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.384939 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.385036 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.385242 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.385332 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.385545 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.385615 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.385837 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.385927 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.386138 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.386253 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.386436 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.386572 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.386757 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.386898 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.387064 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.387200 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.387375 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.387509 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.387694 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.387849 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.387995 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.388141 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.388299 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.388436 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.388605 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.388740 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.388925 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.389055 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.389234 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.389323 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.389537 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.389635 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.389837 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.389922 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.390138 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.390224 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.390478 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.390572 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.390816 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.390904 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.391118 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.391206 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.391432 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.391526 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.391750 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.391835 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.392057 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.392149 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.392364 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.392457 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.392673 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.392759 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.392979 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.393064 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.393288 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.393380 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.393597 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.393681 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.393904 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.394002 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.394208 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.394293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.394512 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.394604 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.394844 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.394942 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.395150 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.395258 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.395461 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.395603 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.395763 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.395850 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.396065 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.396150 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.396370 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.396462 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.396672 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.396767 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.396978 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.397247 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.397334 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.397583 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.397839 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.397937 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.398176 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.398816 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.399046 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.399262 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.399467 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.399600 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.399903 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.399991 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.400247 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.400344 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.400580 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.400668 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.400905 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.401002 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.401216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.401301 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.401522 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.401607 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.401833 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.401931 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.402135 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.402220 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.402438 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.402525 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.402765 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.402870 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.403070 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.403155 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.403375 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.403468 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.403680 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.403784 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.403988 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.404084 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.404287 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.404381 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.404588 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.404677 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.404889 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.404975 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.405191 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.405285 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.405506 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.405635 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.405807 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.405950 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.406116 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.406202 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.406418 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.406506 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.406748 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.406837 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.407056 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.407154 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.407359 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.407451 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.407661 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.407747 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.407963 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.408096 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.408304 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.408397 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.408607 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.408693 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.408945 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.409040 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.409261 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.409347 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.409568 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.409652 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.409888 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.409981 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.410193 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.410277 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.410498 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.410583 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.410826 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.410915 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.411128 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.411221 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.411431 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.411516 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.411738 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.411824 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.412040 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.412132 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.412342 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.412428 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.412652 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.412737 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.412954 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.413038 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.413255 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.413340 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.413560 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.413646 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.413864 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.414036 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.414859 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.415013 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.415141 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.415273 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.415360 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.415589 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.415695 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.415899 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.416004 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.416203 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.416296 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.416509 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.416594 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.416830 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.416942 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.417116 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.417215 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.417419 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.417506 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.417717 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.417810 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.418029 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.418113 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.418328 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.418416 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.418641 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.418730 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.418956 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.419040 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.419263 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.419360 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.419567 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.419653 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.419864 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.419949 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.420186 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.420281 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.420489 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.420575 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.420791 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.420875 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.421094 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.421190 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.421394 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.421478 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.421693 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.421786 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.421996 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.422090 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.422304 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.422390 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.422644 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.422733 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.422945 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.423040 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.423243 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.423328 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.423547 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.423630 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.423844 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.423937 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.424145 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.424229 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.424446 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.424532 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.424745 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.424844 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.425045 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.425141 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.425342 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.425427 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.425637 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.425790 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.425936 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.426065 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.426335 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.426442 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.426550 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.426676 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.426881 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.426980 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.427182 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.427276 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.427483 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.427568 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.427781 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.427865 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.428119 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.428211 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.428416 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.428512 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.428771 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.428857 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.429081 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.429177 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.429394 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.429487 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.429739 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.429896 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.430062 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.430220 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.430435 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.430531 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.430767 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.430869 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.431076 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.431170 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.431386 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.431470 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.431695 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.431780 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.432005 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.432099 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.432308 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.432399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.432610 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.432696 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.432928 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.433014 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.433235 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.433326 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.433544 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.433711 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.433863 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.433949 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.434183 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.434269 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.434483 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.434584 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.434815 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.434903 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.435123 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.435241 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.435431 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.435541 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.435731 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.435876 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.436038 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.436158 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.436342 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.436447 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.436650 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.436736 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.436958 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.437043 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.437267 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.437360 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.437572 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.437658 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.437877 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.437961 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.438176 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.438265 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.438481 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.438565 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.438810 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.438898 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.439110 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.439197 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.439431 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.439518 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.439731 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.439822 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.440029 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.440115 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.440331 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.440415 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.440629 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.440721 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.440932 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.441016 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.441230 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.441362 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.441648 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.441742 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.441962 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.442058 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.442266 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.442352 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.442568 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.442695 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.442901 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.442988 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.443207 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.443292 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.443516 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.443611 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.443819 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.443904 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.444117 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.444237 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.444528 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.444627 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.444836 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.444928 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.445219 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.445333 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.445480 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.445671 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.445840 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.446044 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.446139 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.446348 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.446448 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.446691 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.446782 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.446994 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.447080 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.447294 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.447394 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.447592 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.447688 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.447910 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.447996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.448210 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.448305 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.448528 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.448614 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.448946 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.449071 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.449253 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.449341 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.449554 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.449646 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.449963 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.450049 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.450268 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.450355 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.450572 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.450686 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.450915 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.451023 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.451230 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.451325 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.451546 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.451634 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.451847 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.451933 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.452156 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.452254 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.452459 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.452547 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.452776 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.452862 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.453094 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.453180 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.453399 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.453487 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.453713 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.453809 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.454013 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.454108 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.454331 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.454421 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.454666 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.454757 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.454980 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.455076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.455362 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.455469 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.455700 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.455795 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.456017 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.456161 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.456323 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.456420 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.456640 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.456727 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.456963 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.457058 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.457268 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.457353 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.457578 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.457673 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.457872 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.457961 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.458174 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.458267 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.458471 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.458558 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.458820 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.458917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.459118 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.459204 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.459426 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.459521 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.459731 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.459818 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.460035 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.460120 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.460336 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.460435 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.460633 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.460718 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.461525 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.461687 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.461836 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.462002 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.462132 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.462221 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.462443 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.462530 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.462784 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.462888 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.463102 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.463189 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.463401 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.463488 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.463717 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.463812 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.464021 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.464107 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.464321 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.464407 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.464621 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.464717 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.464923 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.465008 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.465257 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.465342 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.465560 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.465668 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.465872 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.465963 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.466199 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.466287 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.466523 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.466661 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.466857 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.466957 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.467188 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.467275 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.467513 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.467600 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.467827 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.467912 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.468141 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.468237 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.468464 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.468550 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.468770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.468855 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.469068 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.469162 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.469375 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.469468 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.469679 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.469772 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.469976 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.470075 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.470277 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.470363 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.470582 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.470696 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.470906 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.471007 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.471206 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.471294 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.471507 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.471599 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.471822 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.471908 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.472122 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.472214 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.472441 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.472527 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.472746 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.472840 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.473046 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.473252 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.473338 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.473416 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.473636 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.473725 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.473976 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.474070 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.474279 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.474366 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.474603 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.474714 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.474934 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.475029 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.475256 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.475351 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.475575 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.475684 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.475888 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.475984 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.476220 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.476327 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.476579 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.476676 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.476890 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.477110 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.477208 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.477436 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.477532 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.477756 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.477842 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.478068 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.478161 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.478385 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.478473 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.478726 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.478817 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.479050 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.479247 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.479571 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.479657 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.479884 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.479976 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.480197 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.480296 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.480511 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.480610 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.480824 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.480917 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.481138 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.481302 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.481453 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.481583 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.481768 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.481905 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.482080 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.482219 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.482392 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.482529 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.482727 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.482884 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.483055 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.483210 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.483376 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.483538 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.483700 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.483872 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.484033 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.484193 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.484349 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.484510 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.484662 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.484826 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.484977 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.485142 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.485289 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.485503 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.485642 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.485814 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.485957 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.486113 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.486265 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.486433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.486582 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.486775 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.486920 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.487170 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.487256 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.487493 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.487593 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.487807 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.487895 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.488123 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.488209 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.488432 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.488595 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.488829 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.488924 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.489053 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.489140 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.489348 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.489436 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.489657 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.489744 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.489977 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.490063 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.490310 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.490397 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.490672 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.490773 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.490957 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.491042 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.491267 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.491355 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.491581 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.491665 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.492625 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.492781 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.492940 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.493091 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.493266 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.493365 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.493596 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.493691 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.493920 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.494007 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.494233 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.494325 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.494550 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.494677 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.494904 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.494994 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.495211 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.495295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.495514 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.495608 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.495824 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.495916 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.496132 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.496225 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.496434 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.496533 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.496753 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.496901 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.497061 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.497148 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.497362 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.497448 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.497679 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.497763 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.497986 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.498070 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.498514 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.498600 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.498888 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.499009 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.499201 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.499287 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.499527 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.499613 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.499849 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.499935 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.500165 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.500260 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.500469 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.500555 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.500789 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.500875 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.501095 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.501188 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.501396 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.501488 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.501710 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.501795 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.502020 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.502114 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.502322 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.502408 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.502644 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.502735 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.502954 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.503052 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.503258 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.503343 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.503558 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.503644 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.503866 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.503952 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.504167 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.504251 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.504493 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.504597 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.504793 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.504881 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.505094 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.505185 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.505396 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.505482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.505702 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.505788 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.506006 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.506100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.506307 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.506399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.506610 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.506734 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.506935 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.507023 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.507240 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.507402 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.507543 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.507983 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.508110 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.508444 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.508540 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.508761 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.508857 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.509131 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.509256 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.509439 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.509524 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.509752 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.509840 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.510112 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.510199 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.510440 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.510527 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.510769 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.510860 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.511075 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.511160 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.511388 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.511483 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.511695 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.511781 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.512012 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.512098 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.512325 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.512419 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.512635 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.512721 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.512974 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.513065 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.513289 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.513506 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.513824 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.513918 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.514144 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.514236 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.514468 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.514561 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.514823 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.514923 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.515131 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.515217 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.515434 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.515522 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.515737 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.515824 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.516042 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.516134 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.516354 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.516441 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.516663 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.516755 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.516988 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.517094 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.517278 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.517375 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.517583 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.517669 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.517892 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.517987 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.518200 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.518287 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.518506 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.518599 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.518838 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.519008 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.519143 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.519264 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.519449 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.519537 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.519753 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.519847 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.520074 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.520169 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.520363 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.520448 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.520669 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.520756 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.520984 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.521070 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.521304 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.521390 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.521619 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.521706 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.521930 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.522016 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.522243 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.522331 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.522553 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.522673 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.522887 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.522982 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.523193 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.523340 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.523571 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.523711 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.523885 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.524042 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.524200 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.524370 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.524531 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.524688 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.524846 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.524995 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.525152 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.525411 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.525571 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.525724 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.525888 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.526042 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.526211 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.526361 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.526535 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.526691 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.526944 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.527080 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.527271 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.527368 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.527595 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.527689 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.527910 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.527996 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.528215 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.528301 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.528534 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.528620 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.528865 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.528951 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.529186 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.529273 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.529506 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.529606 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.529806 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.529902 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.530107 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.530194 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.530408 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.530493 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.530737 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.530841 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.531048 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.531173 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.531353 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.531448 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.531653 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.531749 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.531951 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.532038 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.532256 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.532342 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.532559 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.532647 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.532860 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.532948 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.533162 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.533248 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.533461 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.533548 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.533764 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.533849 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.534060 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.534149 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.534359 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.534454 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.534678 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.534769 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.534982 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.535078 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.535282 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.535378 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.535585 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.535781 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.535887 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.535987 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.536187 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.536274 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.536484 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.536580 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.536782 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.536881 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.537083 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.537170 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.537380 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.537469 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.537682 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.537781 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.538016 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.538104 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.538324 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.538459 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.538663 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.538793 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.539542 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.539636 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.539855 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.540135 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.540366 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.540481 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.540576 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.540800 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.540886 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.541120 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.541218 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.541436 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.541526 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.541743 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.541829 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.542071 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.542168 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.542379 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.542465 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.542712 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.542803 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.543021 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.543121 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.543328 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.543415 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.543634 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.543720 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.543941 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.544030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.544262 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.544348 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.544586 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.544671 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.544889 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.544977 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.545209 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.545294 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.545523 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.545608 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.545840 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.545927 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.546153 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.546238 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.546461 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.546555 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.546816 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.546903 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.547125 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.547248 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.547432 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.547537 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.547741 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.547826 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.548047 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.548137 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.548353 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.548516 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.548666 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.548753 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.548976 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.549061 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.549281 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.549369 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.549591 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.549703 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.549903 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.550008 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.550225 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.550313 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.550547 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.550655 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.550881 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.550967 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.551201 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.551438 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.551534 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.551615 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.551853 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.551946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.552159 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.552254 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.552498 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.552585 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.552824 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.552918 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.553131 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.553217 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.553439 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.553525 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.553741 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.553836 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:07:35.553981 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 06:07:35.554068 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 06:07:35.707855 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO dbcounter [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Registered counter for database nova_api Aug 26 06:07:35.712840 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO dbcounter [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Registered counter for database nova_api Aug 26 06:07:35.729744 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_db.sqlalchemy.engines [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:07:35.732736 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:07:35.736483 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writer thread running {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:07:35.739262 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:07:35.793488 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.context [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcc5be55-ca87-448b-b1ff-b5f0f867fd3d(cell1) {{(pid=106315) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 06:07:35.797164 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.context [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcc5be55-ca87-448b-b1ff-b5f0f867fd3d(cell1) {{(pid=106314) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 06:07:35.797303 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:07:35.797724 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:07:35.799305 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:07:35.800029 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:07:35.800466 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:07:35.800977 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:07:35.801442 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:07:35.802575 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:07:35.803008 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:07:35.803728 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:07:35.804162 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:07:35.805224 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO dbcounter [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Registered counter for database nova_cell0 Aug 26 06:07:35.807080 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG oslo_concurrency.lockutils [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:07:35.809033 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO dbcounter [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Registered counter for database nova_cell0 Aug 26 06:07:35.810996 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO dbcounter [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Registered counter for database nova_cell1 Aug 26 06:07:35.813212 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO dbcounter [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Registered counter for database nova_cell1 Aug 26 06:07:35.818080 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_db.sqlalchemy.engines [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:07:35.819747 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_db.sqlalchemy.engines [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:07:35.821545 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:07:35.823410 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:07:35.825446 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writer thread running {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:07:35.829062 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:07:35.830563 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writer thread running {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:07:35.965515 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:07:35.970816 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO dbcounter [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Registered counter for database nova_cell0 Aug 26 06:07:35.975509 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO dbcounter [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Registered counter for database nova_cell0 Aug 26 06:07:35.980142 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_db.sqlalchemy.engines [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:07:35.982307 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG oslo_db.sqlalchemy.engines [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:07:35.984594 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writer thread running {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:07:35.986515 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writer thread running {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:07:36.442827 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: WARNING keystonemiddleware.auth_token [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 06:07:36.450865 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: WARNING keystonemiddleware.auth_token [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 06:07:36.464313 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 06:07:36.471548 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 06:07:36.793590 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: WARNING keystonemiddleware.auth_token [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 06:07:36.799645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: WARNING keystonemiddleware.auth_token [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 06:07:36.805602 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c54ca5a9c0 pid: 106315 (default app) Aug 26 06:07:36.807699 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:07:36.808862 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001710 Aug 26 06:07:36.809271 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Fri Aug 26 06:07:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:07:36.811224 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 06:07:36.817172 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: WARNING keystonemiddleware.auth_token [None req-8c048cb9-08a8-4d12-8622-bb0f52c5aa1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 06:07:36.823273 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c54ca5a9c0 pid: 106314 (default app) Aug 26 06:08:59.038340 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:08:59.040373 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002226 Aug 26 06:08:59.040893 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:08:59.053683 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=3 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:08:59.055112 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_cell1:SELECT=3 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:08:59.056363 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_cell0:SELECT=3 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:08:59.057580 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:08:59.917039 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-bfbae727-1781-48f9-918a-f59b9ce91582 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:08:59.949558 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-bfbae727-1781-48f9-918a-f59b9ce91582 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.901155 Aug 26 06:08:59.950402 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 26 06:08:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:09:02.450896 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:02.451569 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-16b43819-5afa-47a1-8df8-9127f160ad58 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001973 Aug 26 06:09:02.451885 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:02.977780 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-88ce0e14-ae49-4dfd-a7b0-453bd0e84b2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "cirros256", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:03.321552 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-88ce0e14-ae49-4dfd-a7b0-453bd0e84b2b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.863552 Aug 26 06:09:03.322045 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 06:09:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:09:03.555088 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-ebe86c15-5f8d-443a-b469-7bd050ae19df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:03.561654 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_api:SELECT=3 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:09:03.562588 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_cell0:SELECT=3 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:09:03.563589 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_cell1:SELECT=3 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:09:03.564340 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:09:03.706223 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-ebe86c15-5f8d-443a-b469-7bd050ae19df admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.375524 Aug 26 06:09:03.707044 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 26 06:09:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:09:06.071637 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-88ce0e14-ae49-4dfd-a7b0-453bd0e84b2b admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:06.072647 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-88ce0e14-ae49-4dfd-a7b0-453bd0e84b2b admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 26 06:09:06.073030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:06.732183 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-76817af2-3ae2-48cc-9f9f-1e08ebad89cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "ram": 512, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:06.876404 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-76817af2-3ae2-48cc-9f9f-1e08ebad89cd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.796788 Aug 26 06:09:06.876962 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 06:09:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 06:09:06.891853 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-ae52329f-4be8-4f45-96da-4d15d29efb61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:07.041684 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-ae52329f-4be8-4f45-96da-4d15d29efb61 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.153979 Aug 26 06:09:07.042491 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 26 06:09:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:09:09.565919 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-76817af2-3ae2-48cc-9f9f-1e08ebad89cd admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:09.567102 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-76817af2-3ae2-48cc-9f9f-1e08ebad89cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 26 06:09:09.567542 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:09.991999 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fb716154-4252-4efa-aa8a-2326fba55826 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:10.091302 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-fb716154-4252-4efa-aa8a-2326fba55826 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.516155 Aug 26 06:09:10.091853 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 06:09:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:09:10.104416 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-3a0d4d51-7af1-4b22-b546-07649dbe7dfa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:10.217485 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-3a0d4d51-7af1-4b22-b546-07649dbe7dfa admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116974 Aug 26 06:09:10.218116 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 26 06:09:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:09:12.744018 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fb716154-4252-4efa-aa8a-2326fba55826 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:12.744967 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-fb716154-4252-4efa-aa8a-2326fba55826 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 26 06:09:12.745355 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:13.180598 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-6b8275ab-97ee-4926-a5ec-951136584332 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:13.418885 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-6b8275ab-97ee-4926-a5ec-951136584332 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.667373 Aug 26 06:09:13.419432 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 06:09:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:09:13.432576 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-467ad9e4-8671-46cb-b2cf-7434e5f3d5d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:13.586952 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-467ad9e4-8671-46cb-b2cf-7434e5f3d5d9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.158142 Aug 26 06:09:13.587811 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 26 06:09:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:09:16.077253 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-6b8275ab-97ee-4926-a5ec-951136584332 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:16.082318 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-6b8275ab-97ee-4926-a5ec-951136584332 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 26 06:09:16.082318 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:09:16.590688 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-4df389e6-d3b1-49c3-b707-a7b46982fc58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:16.683732 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-4df389e6-d3b1-49c3-b707-a7b46982fc58 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.597331 Aug 26 06:09:16.684793 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 06:09:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:09:16.698813 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-2ed11146-c0fa-43ca-a766-be0c2de4b7d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:16.788097 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-2ed11146-c0fa-43ca-a766-be0c2de4b7d4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093006 Aug 26 06:09:16.788618 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Fri Aug 26 06:09:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:09:19.255659 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-4df389e6-d3b1-49c3-b707-a7b46982fc58 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:19.256683 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-4df389e6-d3b1-49c3-b707-a7b46982fc58 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Aug 26 06:09:19.257083 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:09:19.739600 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-eb8ad120-84ed-4dfc-a0ea-4618e7952867 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:19.765415 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-eb8ad120-84ed-4dfc-a0ea-4618e7952867 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.502126 Aug 26 06:09:19.765953 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 26 06:09:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:09:22.183149 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-4df389e6-d3b1-49c3-b707-a7b46982fc58 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:22.184176 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-4df389e6-d3b1-49c3-b707-a7b46982fc58 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Aug 26 06:09:22.184580 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:22.628637 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-0d26c632-d08f-4724-9112-b870f3abf83a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:22.736395 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-0d26c632-d08f-4724-9112-b870f3abf83a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.545725 Aug 26 06:09:22.737069 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 06:09:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:09:22.749286 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-4ae32aac-97b7-443f-8122-b72350ab212a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:22.862050 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-4ae32aac-97b7-443f-8122-b72350ab212a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116328 Aug 26 06:09:22.862645 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 26 06:09:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:09:25.289123 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-0d26c632-d08f-4724-9112-b870f3abf83a admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:25.290458 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-0d26c632-d08f-4724-9112-b870f3abf83a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 26 06:09:25.290920 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:25.680396 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-eb5a408c-5280-4e9e-ae7a-4d6705af0077 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "2", "disk": 20, "name": "m1.small"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:25.790424 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-eb5a408c-5280-4e9e-ae7a-4d6705af0077 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.492791 Aug 26 06:09:25.791027 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 06:09:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 06:09:25.804003 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-71c93d09-b061-4655-9a1f-5df7c8923dfd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:25.945963 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-71c93d09-b061-4655-9a1f-5df7c8923dfd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146344 Aug 26 06:09:25.946479 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 26 06:09:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:09:28.347392 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-eb5a408c-5280-4e9e-ae7a-4d6705af0077 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:28.349072 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-eb5a408c-5280-4e9e-ae7a-4d6705af0077 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 26 06:09:28.349485 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:28.815584 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-b2064ce0-f5b5-4db4-bf3a-b4e6037860f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:29.614743 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-b2064ce0-f5b5-4db4-bf3a-b4e6037860f1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.257138 Aug 26 06:09:29.614743 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 06:09:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:09:29.625711 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-305411f3-8ac8-4442-a70c-26f77806a763 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:29.632349 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:09:29.860558 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-305411f3-8ac8-4442-a70c-26f77806a763 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.238467 Aug 26 06:09:29.863641 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 26 06:09:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:09:32.347623 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-b2064ce0-f5b5-4db4-bf3a-b4e6037860f1 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:32.348721 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-b2064ce0-f5b5-4db4-bf3a-b4e6037860f1 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Aug 26 06:09:32.349276 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:32.788494 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-3b2939c8-6c13-458f-ab01-d0bc6cde1599 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "disk": 80, "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:32.887826 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-3b2939c8-6c13-458f-ab01-d0bc6cde1599 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.528419 Aug 26 06:09:32.889089 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 06:09:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:09:32.904965 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-4c091a2c-2f74-476a-9cde-afb1469f75b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:33.068175 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-4c091a2c-2f74-476a-9cde-afb1469f75b5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.166721 Aug 26 06:09:33.068871 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 26 06:09:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:09:35.507501 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-3b2939c8-6c13-458f-ab01-d0bc6cde1599 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:35.509198 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-3b2939c8-6c13-458f-ab01-d0bc6cde1599 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002251 Aug 26 06:09:35.509598 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:35.974073 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-6b672904-211d-40ca-9341-b4bfaa6bc712 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:36.095715 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-6b672904-211d-40ca-9341-b4bfaa6bc712 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.579176 Aug 26 06:09:36.096499 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Fri Aug 26 06:09:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 06:09:36.108953 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-fb2a0cfd-c792-4128-9f35-8b9c9ab02d58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:09:36.286450 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-fb2a0cfd-c792-4128-9f35-8b9c9ab02d58 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.180948 Aug 26 06:09:36.287683 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Fri Aug 26 06:09:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:09:55.299780 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-6b672904-211d-40ca-9341-b4bfaa6bc712 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:55.300867 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-6b672904-211d-40ca-9341-b4bfaa6bc712 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 26 06:09:55.301365 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:09:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:55.312134 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:09:55.740979 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-93a495ba-2df8-4374-8b8d-b9a1200bf812 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:55.759943 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-93a495ba-2df8-4374-8b8d-b9a1200bf812 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.452178 Aug 26 06:09:55.760487 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 26 06:09:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:09:56.912265 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-6b672904-211d-40ca-9341-b4bfaa6bc712 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:56.913312 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-6b672904-211d-40ca-9341-b4bfaa6bc712 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 26 06:09:56.913719 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:09:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:57.483116 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-a28dfc30-d437-4678-b07b-b93ead650b46 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:57.490074 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.wsgi [None req-a28dfc30-d437-4678-b07b-b93ead650b46 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-a28dfc30-d437-4678-b07b-b93ead650b46 admin admin] Request method failure captured: Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Accept: application/json Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Accept-Encoding: gzip, deflate Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Connection: keep-alive Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Content-Length: 0 Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Host: 10.222.0.40 Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Openstack-Api-Version: compute 2.90 Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Openstack-System-Scope: None Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: User-Agent: python-novaclient Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Auth-Token: gAAAAABjCGO07DGgHDf-xW8VYtaEmNLu1kiXjaTgyJJosITaHB2Bn7NZA4LAO5jh00eYint4xj1qSV36_s-JGrtQYxCWHRQiY_KrmDXlbdocglXrzWiJX12P96PXiYa2rc_RSRPeYUA8xxLzuS3z7Y3YY--5E8JLTlaf1KJ8rXJ55r6Qx9K2Ids Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Domain-Id: None Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Domain-Name: None Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Identity-Status: Confirmed Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Is-Admin-Project: True Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Domain-Id: default Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Domain-Name: Default Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Name: admin Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Role: admin,member,reader Aug 26 06:09:57.493372 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Roles: admin,member,reader Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Tenant: admin Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Tenant-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Tenant-Name: admin Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User: admin Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Domain-Id: default Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Domain-Name: Default Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Id: d4b059129fcd4293b7ae6f76c1ca5b3e Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Name: admin Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: method: > Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: exception: Flavor 42 could not be found. Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: action_args: {'id': '42'} Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:09:57.495399 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:09:57.496592 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:09:57.497996 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-a28dfc30-d437-4678-b07b-b93ead650b46 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:09:57.499615 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-a28dfc30-d437-4678-b07b-b93ead650b46 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.435800 Aug 26 06:09:57.499615 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 26 06:09:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 06:09:57.505168 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-0e8b4233-20ae-4180-8a8e-1c60595d3e02 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:57.509729 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:09:57.528412 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-0e8b4233-20ae-4180-8a8e-1c60595d3e02 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027254 Aug 26 06:09:57.528982 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 06:09:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:09:57.539637 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-11345cea-dac5-4c60-a808-eb72defad21c admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:57.564342 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-11345cea-dac5-4c60-a808-eb72defad21c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028218 Aug 26 06:09:57.564932 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 06:09:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:09:57.574755 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-fb970299-8719-4a6d-b304-1e088c5d07ed admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:57.580771 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.wsgi [None req-fb970299-8719-4a6d-b304-1e088c5d07ed admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-fb970299-8719-4a6d-b304-1e088c5d07ed admin admin] Request method failure captured: Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Accept: application/json Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Accept-Encoding: gzip, deflate Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Connection: keep-alive Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Content-Length: 0 Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Host: 10.222.0.40 Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Openstack-Api-Version: compute 2.90 Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Openstack-System-Scope: None Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: User-Agent: python-novaclient Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Auth-Token: gAAAAABjCGO07DGgHDf-xW8VYtaEmNLu1kiXjaTgyJJosITaHB2Bn7NZA4LAO5jh00eYint4xj1qSV36_s-JGrtQYxCWHRQiY_KrmDXlbdocglXrzWiJX12P96PXiYa2rc_RSRPeYUA8xxLzuS3z7Y3YY--5E8JLTlaf1KJ8rXJ55r6Qx9K2Ids Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Domain-Id: None Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Domain-Name: None Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Identity-Status: Confirmed Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Is-Admin-Project: True Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Domain-Id: default Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Domain-Name: Default Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Name: admin Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Role: admin,member,reader Aug 26 06:09:57.584216 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Roles: admin,member,reader Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Tenant: admin Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Tenant-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Tenant-Name: admin Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User: admin Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Domain-Id: default Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Domain-Name: Default Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Id: d4b059129fcd4293b7ae6f76c1ca5b3e Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Name: admin Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: method: > Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: exception: Flavor 42 could not be found. Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: action_args: {'id': '42'} Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:09:57.585917 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:09:57.586944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:09:57.588295 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-fb970299-8719-4a6d-b304-1e088c5d07ed admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:09:57.589616 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-fb970299-8719-4a6d-b304-1e088c5d07ed admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014678 Aug 26 06:09:57.589616 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 26 06:09:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 06:09:58.571925 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-11345cea-dac5-4c60-a808-eb72defad21c admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:58.572953 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-11345cea-dac5-4c60-a808-eb72defad21c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 26 06:09:58.573443 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:09:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:09:59.150574 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-85f2c5dc-962c-47ab-9851-432d55307eb0 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:59.156068 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.wsgi [None req-85f2c5dc-962c-47ab-9851-432d55307eb0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-85f2c5dc-962c-47ab-9851-432d55307eb0 admin admin] Request method failure captured: Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Accept: application/json Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Accept-Encoding: gzip, deflate Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Connection: keep-alive Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Content-Length: 0 Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Host: 10.222.0.40 Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Openstack-Api-Version: compute 2.90 Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Openstack-System-Scope: None Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: User-Agent: python-novaclient Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Auth-Token: gAAAAABjCGO2M9mIt4NtFHqeE-LKG_pyepiR7TcR_4ADQCfVGOKvE33cXw6fQo55I6dc0Vd9x8-8qqRkwl7QefOZtLxwmXc84C0_Dc_dmryuOgskCshdua01MO0o7MAFVjFX8hcVt8BqlFByAtcXHcOSm9H3cBiXGRRuIM41H6-2rIzwOvJ65jI Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Domain-Id: None Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Domain-Name: None Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Identity-Status: Confirmed Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Is-Admin-Project: True Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Domain-Id: default Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Domain-Name: Default Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Name: admin Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Role: admin,member,reader Aug 26 06:09:59.157545 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Roles: admin,member,reader Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Tenant: admin Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Tenant-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Tenant-Name: admin Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User: admin Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Domain-Id: default Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Domain-Name: Default Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Id: d4b059129fcd4293b7ae6f76c1ca5b3e Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Name: admin Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: method: > Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: exception: Flavor 84 could not be found. Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: action_args: {'id': '84'} Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:09:59.159098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:09:59.160645 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:09:59.161926 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-85f2c5dc-962c-47ab-9851-432d55307eb0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:09:59.163212 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-85f2c5dc-962c-47ab-9851-432d55307eb0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.440221 Aug 26 06:09:59.163212 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 26 06:09:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 06:09:59.170357 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-085894d2-0a49-4f16-8d81-58dc0b4e0d9b admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:59.187159 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-085894d2-0a49-4f16-8d81-58dc0b4e0d9b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020793 Aug 26 06:09:59.187718 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 06:09:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:09:59.197763 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-7b9710ff-212b-426d-a246-502335c283d5 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:59.215432 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-7b9710ff-212b-426d-a246-502335c283d5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021199 Aug 26 06:09:59.215993 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 06:09:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:09:59.226459 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-164a8a54-732f-4ce7-921e-c18bb5dd987e admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:09:59.232302 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.wsgi [None req-164a8a54-732f-4ce7-921e-c18bb5dd987e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-164a8a54-732f-4ce7-921e-c18bb5dd987e admin admin] Request method failure captured: Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Accept: application/json Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Accept-Encoding: gzip, deflate Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Connection: keep-alive Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Content-Length: 0 Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Host: 10.222.0.40 Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Openstack-Api-Version: compute 2.90 Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Openstack-System-Scope: None Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: User-Agent: python-novaclient Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Auth-Token: gAAAAABjCGO2M9mIt4NtFHqeE-LKG_pyepiR7TcR_4ADQCfVGOKvE33cXw6fQo55I6dc0Vd9x8-8qqRkwl7QefOZtLxwmXc84C0_Dc_dmryuOgskCshdua01MO0o7MAFVjFX8hcVt8BqlFByAtcXHcOSm9H3cBiXGRRuIM41H6-2rIzwOvJ65jI Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Domain-Id: None Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Domain-Name: None Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Identity-Status: Confirmed Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Is-Admin-Project: True Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Domain-Id: default Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Domain-Name: Default Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Name: admin Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Role: admin,member,reader Aug 26 06:09:59.233946 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Roles: admin,member,reader Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Tenant: admin Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Tenant-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Tenant-Name: admin Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User: admin Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Domain-Id: default Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Domain-Name: Default Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Id: d4b059129fcd4293b7ae6f76c1ca5b3e Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Name: admin Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: method: > Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: exception: Flavor 84 could not be found. Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: action_args: {'id': '84'} Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:09:59.235514 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:09:59.236433 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:09:59.237678 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-164a8a54-732f-4ce7-921e-c18bb5dd987e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:09:59.238966 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-164a8a54-732f-4ce7-921e-c18bb5dd987e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013470 Aug 26 06:09:59.238966 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Fri Aug 26 06:09:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 06:10:00.252389 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-7b9710ff-212b-426d-a246-502335c283d5 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:10:00.253434 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-7b9710ff-212b-426d-a246-502335c283d5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Aug 26 06:10:00.254455 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:10:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:10:00.850690 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-bc785066-9b2f-4fa0-9279-b0c829ae0a7d admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:10:00.856569 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.wsgi [None req-bc785066-9b2f-4fa0-9279-b0c829ae0a7d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-bc785066-9b2f-4fa0-9279-b0c829ae0a7d admin admin] Request method failure captured: Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Accept: application/json Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Accept-Encoding: gzip, deflate Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Connection: keep-alive Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Content-Length: 0 Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Host: 10.222.0.40 Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Openstack-Api-Version: compute 2.90 Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Openstack-System-Scope: None Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: User-Agent: python-novaclient Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Auth-Token: gAAAAABjCGO4IAnMy2U0splHI5rGGhmHRLZamqwgZTtcOzWgLljpJezelsEypvrrbbpTj8BHMy2hJrynO1FnY1uCCn83hR7msahj1DfmwtGSCgdk5sa-TBCY5xLwPugKhn5Wnhi6xRf1zykre1KFHMHYIHTM8LCX2mo5MMjIocaRhCkRYuayhWw Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Domain-Id: None Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Domain-Name: None Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Identity-Status: Confirmed Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Is-Admin-Project: True Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Domain-Id: default Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Domain-Name: Default Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Project-Name: admin Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Role: admin,member,reader Aug 26 06:10:00.858076 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Roles: admin,member,reader Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Tenant: admin Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Tenant-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-Tenant-Name: admin Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User: admin Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Domain-Id: default Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Domain-Name: Default Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Id: d4b059129fcd4293b7ae6f76c1ca5b3e Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: X-User-Name: admin Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: method: > Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: exception: Flavor 451 could not be found. Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: action_args: {'id': '451'} Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:10:00.859760 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:10:00.860770 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: ERROR nova.api.openstack.wsgi Aug 26 06:10:00.862030 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-bc785066-9b2f-4fa0-9279-b0c829ae0a7d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:10:00.875930 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-bc785066-9b2f-4fa0-9279-b0c829ae0a7d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.464506 Aug 26 06:10:00.875930 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 06:10:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 466 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 06:10:00.876098 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-e923d8b1-8289-4572-a7b8-379b3c89f0d3 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:10:00.890413 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-e923d8b1-8289-4572-a7b8-379b3c89f0d3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019762 Aug 26 06:10:00.891020 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 06:10:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:10:00.903174 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:10:00.919886 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021181 Aug 26 06:10:00.920461 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Fri Aug 26 06:10:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:10:00.930218 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-ad4c2e06-0bc9-428b-abff-dac0f2fe7393 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.wsgi [None req-ad4c2e06-0bc9-428b-abff-dac0f2fe7393 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-ad4c2e06-0bc9-428b-abff-dac0f2fe7393 admin admin] Request method failure captured: Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Accept: application/json Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Accept-Encoding: gzip, deflate Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Connection: keep-alive Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Content-Length: 0 Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Host: 10.222.0.40 Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Openstack-Api-Version: compute 2.90 Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Openstack-System-Scope: None Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: User-Agent: python-novaclient Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Auth-Token: gAAAAABjCGO4IAnMy2U0splHI5rGGhmHRLZamqwgZTtcOzWgLljpJezelsEypvrrbbpTj8BHMy2hJrynO1FnY1uCCn83hR7msahj1DfmwtGSCgdk5sa-TBCY5xLwPugKhn5Wnhi6xRf1zykre1KFHMHYIHTM8LCX2mo5MMjIocaRhCkRYuayhWw Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Domain-Id: None Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Domain-Name: None Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Identity-Status: Confirmed Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Is-Admin-Project: True Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Domain-Id: default Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Domain-Name: Default Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Project-Name: admin Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Role: admin,member,reader Aug 26 06:10:00.943482 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Roles: admin,member,reader Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6316e285f13041a3ae4690b463c7dfa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Tenant: admin Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Tenant-Id: 6316e285f13041a3ae4690b463c7dfa7 Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-Tenant-Name: admin Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User: admin Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Domain-Id: default Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Domain-Name: Default Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Id: d4b059129fcd4293b7ae6f76c1ca5b3e Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: X-User-Name: admin Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: method: > Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: exception: Flavor 451 could not be found. Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: action_args: {'id': '451'} Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:10:00.945100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:10:00.946100 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: ERROR nova.api.openstack.wsgi Aug 26 06:10:00.947293 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-ad4c2e06-0bc9-428b-abff-dac0f2fe7393 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106315) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:10:00.948391 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-ad4c2e06-0bc9-428b-abff-dac0f2fe7393 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012069 Aug 26 06:10:00.948391 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 06:10:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 06:10:01.961887 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:10:01.962936 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 26 06:10:01.963340 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:10:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:10:02.504786 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-ebdef648-9764-4baa-bc08-9971dc94c0d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:10:02.693159 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-ebdef648-9764-4baa-bc08-9971dc94c0d5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.589526 Aug 26 06:10:02.693706 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 26 06:10:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:10:03.716334 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:10:03.717351 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 26 06:10:03.717769 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:10:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:10:04.277781 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-b21197af-54c5-47d0-b1c0-993ec56cbc30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:10:04.447014 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-b21197af-54c5-47d0-b1c0-993ec56cbc30 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.587214 Aug 26 06:10:04.447140 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 26 06:10:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:10:05.434291 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:10:05.435339 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 26 06:10:05.435762 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:10:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:10:05.979833 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-d3a9fb67-06ae-4158-a871-181e38ade00b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:10:06.242099 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-d3a9fb67-06ae-4158-a871-181e38ade00b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.665334 Aug 26 06:10:06.242663 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 26 06:10:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:10:07.254584 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:10:07.255666 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002197 Aug 26 06:10:07.256062 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:10:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:10:07.809280 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-e25ea3b4-4238-4248-a7e1-d5401d3d7be7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:10:07.925901 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-e25ea3b4-4238-4248-a7e1-d5401d3d7be7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.529469 Aug 26 06:10:07.930350 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Fri Aug 26 06:10:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 06:10:08.921028 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:10:08.922035 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 26 06:10:08.922428 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:10:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:10:09.489668 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-23fdfe01-17b4-476f-9e1b-2d85bda71011 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:10:09.511395 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-23fdfe01-17b4-476f-9e1b-2d85bda71011 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.450014 Aug 26 06:10:09.511942 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Fri Aug 26 06:10:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:11:05.750464 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:11:05.751933 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-5d811a8e-085c-4849-a86e-a9af4b3a191d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 26 06:11:05.752344 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Fri Aug 26 06:11:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:11:05.759389 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:11:06.174457 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-2e61de06-32dc-4c04-beb3-a004535ac746 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:11:06.195772 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-2e61de06-32dc-4c04-beb3-a004535ac746 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.437172 Aug 26 06:11:06.196323 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Fri Aug 26 06:11:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:11:06.217713 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG dbcounter [-] [106314] Writing DB stats nova_api:SELECT=14 {{(pid=106314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:11:06.221489 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-4f7124d5-09f0-4787-9aba-66bfc5938102 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:11:06.229202 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-4f7124d5-09f0-4787-9aba-66bfc5938102 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012856 Aug 26 06:11:06.229745 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Fri Aug 26 06:11:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:11:06.242366 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-394da9ef-a56e-4b71-a237-6181abfa3df6 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:11:06.250269 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-394da9ef-a56e-4b71-a237-6181abfa3df6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011557 Aug 26 06:11:06.250850 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Fri Aug 26 06:11:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:11:06.263580 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-e725437a-6af5-4376-97bb-072d5bb441b7 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:11:06.271556 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-e725437a-6af5-4376-97bb-072d5bb441b7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011646 Aug 26 06:11:06.272101 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Fri Aug 26 06:11:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:11:06.284931 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-143ae70d-d479-4e17-9e2e-fef0e9f82623 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:11:06.293276 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-143ae70d-d479-4e17-9e2e-fef0e9f82623 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012724 Aug 26 06:11:06.293875 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Fri Aug 26 06:11:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:14:24.581313 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-e725437a-6af5-4376-97bb-072d5bb441b7 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:14:24.582322 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-e725437a-6af5-4376-97bb-072d5bb441b7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 26 06:14:24.582730 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:14:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:14:24.728595 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_api:SELECT=6 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:14:24.887206 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-c2cdd1cf-af1c-4dda-b429-4fdb5550003c admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:14:24.890572 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-c2cdd1cf-af1c-4dda-b429-4fdb5550003c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:14:24.891074 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-c2cdd1cf-af1c-4dda-b429-4fdb5550003c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:14:24.891503 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-c2cdd1cf-af1c-4dda-b429-4fdb5550003c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:14:24.892213 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-c2cdd1cf-af1c-4dda-b429-4fdb5550003c admin admin] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:14:24.892655 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-c2cdd1cf-af1c-4dda-b429-4fdb5550003c admin admin] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:14:24.893068 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-c2cdd1cf-af1c-4dda-b429-4fdb5550003c admin admin] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:14:24.927713 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-c2cdd1cf-af1c-4dda-b429-4fdb5550003c admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204322 Aug 26 06:14:24.928275 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 06:14:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:14:25.761056 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-e725437a-6af5-4376-97bb-072d5bb441b7 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:14:25.762104 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-e725437a-6af5-4376-97bb-072d5bb441b7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Aug 26 06:14:25.762497 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:14:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:14:25.957456 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-0ae52543-9a14-44a1-98a6-f4df009c048c admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:14:25.960944 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-0ae52543-9a14-44a1-98a6-f4df009c048c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:14:25.961412 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-0ae52543-9a14-44a1-98a6-f4df009c048c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:14:25.961900 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-0ae52543-9a14-44a1-98a6-f4df009c048c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:14:25.962605 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-0ae52543-9a14-44a1-98a6-f4df009c048c admin admin] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:14:25.963079 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-0ae52543-9a14-44a1-98a6-f4df009c048c admin admin] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:14:25.964017 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-0ae52543-9a14-44a1-98a6-f4df009c048c admin admin] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:14:25.983850 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-0ae52543-9a14-44a1-98a6-f4df009c048c admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081461 Aug 26 06:14:25.984336 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 06:14:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:14:37.248479 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-e725437a-6af5-4376-97bb-072d5bb441b7 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:14:37.249512 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-e725437a-6af5-4376-97bb-072d5bb441b7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 26 06:14:37.249903 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:14:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:14:37.408045 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_cell0:SELECT=4 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:14:37.408759 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_cell1:SELECT=4 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:14:37.409381 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG dbcounter [-] [106315] Writing DB stats nova_api:SELECT=8 {{(pid=106315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:14:37.460160 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-820a46c5-dc8f-4921-9f1a-7565952c864f admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:14:37.464103 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-820a46c5-dc8f-4921-9f1a-7565952c864f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:14:37.464569 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-820a46c5-dc8f-4921-9f1a-7565952c864f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:14:37.465008 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-820a46c5-dc8f-4921-9f1a-7565952c864f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:14:37.465710 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-820a46c5-dc8f-4921-9f1a-7565952c864f admin admin] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:14:37.466145 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-820a46c5-dc8f-4921-9f1a-7565952c864f admin admin] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:14:37.466558 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-820a46c5-dc8f-4921-9f1a-7565952c864f admin admin] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:14:37.491750 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-820a46c5-dc8f-4921-9f1a-7565952c864f admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088089 Aug 26 06:14:37.492314 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 06:14:37 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:14:38.337055 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: DEBUG nova.api.openstack.wsgi [None req-e725437a-6af5-4376-97bb-072d5bb441b7 admin admin] Calling method '>' {{(pid=106314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:14:38.338130 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: INFO nova.api.openstack.requestlog [None req-e725437a-6af5-4376-97bb-072d5bb441b7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 26 06:14:38.339104 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: [pid: 106314|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Fri Aug 26 06:14:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:14:38.541124 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG nova.api.openstack.wsgi [None req-3a34b73d-f298-4c6b-aff9-2dc9545e6a33 admin admin] Calling method '>' {{(pid=106315) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:14:38.544634 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-3a34b73d-f298-4c6b-aff9-2dc9545e6a33 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:14:38.545056 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-3a34b73d-f298-4c6b-aff9-2dc9545e6a33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:14:38.545483 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-3a34b73d-f298-4c6b-aff9-2dc9545e6a33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:14:38.546191 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-3a34b73d-f298-4c6b-aff9-2dc9545e6a33 admin admin] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:14:38.546644 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-3a34b73d-f298-4c6b-aff9-2dc9545e6a33 admin admin] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:14:38.547065 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: DEBUG oslo_concurrency.lockutils [None req-3a34b73d-f298-4c6b-aff9-2dc9545e6a33 admin admin] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106315) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:14:38.569249 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: INFO nova.api.openstack.requestlog [None req-3a34b73d-f298-4c6b-aff9-2dc9545e6a33 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088125 Aug 26 06:14:38.569792 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: [pid: 106315|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Fri Aug 26 06:14:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:15:36.740333 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: Fri Aug 26 06:15:36 2022 - graceful shutdown triggered... Aug 26 06:15:36.741156 dv-cinder-853910-3-iscsi devstack@n-api.service[106315]: Gracefully killing worker 2 (pid: 106315)... Aug 26 06:15:36.740733 dv-cinder-853910-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 26 06:15:36.742213 dv-cinder-853910-3-iscsi devstack@n-api.service[106314]: Gracefully killing worker 1 (pid: 106314)... Aug 26 06:15:37.741512 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: worker 1 buried after 1 seconds Aug 26 06:15:37.741512 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: worker 2 buried after 1 seconds Aug 26 06:15:37.742878 dv-cinder-853910-3-iscsi devstack@n-api.service[106313]: goodbye to uWSGI. Aug 26 06:15:37.743692 dv-cinder-853910-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 26 06:15:37.744325 dv-cinder-853910-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 26 06:15:37.747596 dv-cinder-853910-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 06:15:37.767322 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 06:15:37.770284 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 06:15:37 2022] *** Aug 26 06:15:37.770284 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 06:15:37.770284 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 06:15:37.770284 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: nodename: dv-cinder-853910-3-iscsi Aug 26 06:15:37.770284 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: machine: x86_64 Aug 26 06:15:37.770284 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: clock source: unix Aug 26 06:15:37.771102 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: pcre jit disabled Aug 26 06:15:37.771102 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: detected number of CPU cores: 4 Aug 26 06:15:37.771102 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: current working directory: / Aug 26 06:15:37.771102 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: detected binary path: /usr/bin/uwsgi-core Aug 26 06:15:37.771102 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: your processes number limit is 47680 Aug 26 06:15:37.771102 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: your memory page size is 4096 bytes Aug 26 06:15:37.771102 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: detected max file descriptor number: 2048 Aug 26 06:15:37.771102 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: lock engine: pthread robust mutexes Aug 26 06:15:37.771102 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: thunder lock: enabled Aug 26 06:15:37.771102 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 06:15:37.771102 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 06:15:37.835564 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: Python main interpreter initialized at 0x55efab9f59c0 Aug 26 06:15:37.835564 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: python threads support enabled Aug 26 06:15:37.835564 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: your server socket listen backlog is limited to 100 connections Aug 26 06:15:37.835564 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: your mercy for graceful operations on workers is 90 seconds Aug 26 06:15:37.836141 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 06:15:37.836259 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: *** Operational MODE: preforking *** Aug 26 06:15:37.836716 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: *** uWSGI is running in multiple interpreter mode *** Aug 26 06:15:37.836716 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: spawned uWSGI master process (pid: 121327) Aug 26 06:15:37.837002 dv-cinder-853910-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 06:15:37.838669 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: spawned uWSGI worker 1 (pid: 121343, cores: 1) Aug 26 06:15:37.839210 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: spawned uWSGI worker 2 (pid: 121344, cores: 1) Aug 26 06:15:37.839445 dv-cinder-853910-3-iscsi devstack@n-api.service[121327]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 06:15:38.541608 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 06:15:38.736047 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 06:15:39.748339 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 06:15:39.748339 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: from cryptography.utils import int_from_bytes Aug 26 06:15:39.749051 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 06:15:39.749051 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: from cryptography.utils import int_from_bytes Aug 26 06:15:40.050217 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 06:15:40.050217 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: from cryptography.utils import int_from_bytes Aug 26 06:15:40.050912 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 06:15:40.050912 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: from cryptography.utils import int_from_bytes Aug 26 06:15:42.367541 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 06:15:42.368737 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 06:15:42.369904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 06:15:42.370836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 06:15:42.371527 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 06:15:42.372560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.373341 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.374121 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.374939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.375768 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.376281 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.377057 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.377851 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.378721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.379416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.380200 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.381419 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-3-iscsi {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.382019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.383467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.384398 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.385282 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.386149 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.387083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.387959 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.389396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.390298 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.391135 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.391992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.392900 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.393779 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.394705 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.395619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.396473 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.397375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.398878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.399912 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-3-iscsi {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.400787 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.401673 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.402547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.403671 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.404546 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.405425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.406315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.407315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.408197 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.409111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.410011 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.410903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.411814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.412681 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.413539 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.414457 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.415621 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.416469 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.417321 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.418106 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.419024 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.419898 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.420795 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.421672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.422469 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.423259 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.424151 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.425077 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.425943 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.426879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.427778 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.428667 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.429571 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.430451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.431391 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.432239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.433083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.433944 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.434843 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.435650 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.436466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.437442 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.438124 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.438984 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.439849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.440647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.441492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.442312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.443173 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.443974 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.444769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.446092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.446926 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.447739 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.448519 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.449170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.449939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.450789 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.451590 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.452403 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.453184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.453969 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.454775 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.455557 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.456333 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.457147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.457924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.458765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.460826 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.461624 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.462386 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.463193 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.464030 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.464864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.465671 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.466468 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.467311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.468103 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.468955 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.469745 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.470507 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.471348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.472141 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.472949 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.473762 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.474540 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.475396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.476196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.477518 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.478309 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.479163 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.479742 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.480291 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.480842 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.481399 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.482160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.483001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.483826 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.484397 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.484950 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.485526 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.486115 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.486741 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.487313 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.487887 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.488483 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.489105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.489696 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.490992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.490992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.491602 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.492836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.493389 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.493927 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.494452 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.495107 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.495726 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.496298 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.496866 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.497463 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.498060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.498774 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.499365 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.500866 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.500866 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.501278 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.501732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.502317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.502976 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.503556 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.504119 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.504493 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.504827 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.505172 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.505514 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.505880 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.506284 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.506775 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.507018 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.507538 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.507938 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.508331 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.508692 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.509130 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.509686 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.510248 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.510848 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.511667 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.512244 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.512861 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.513402 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.514015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.514360 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.514715 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.515068 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.515393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.515951 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.516507 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.516987 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.517327 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.517815 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.518399 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.518986 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.519336 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.519696 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.520002 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.520983 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.520983 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.521424 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.521777 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.522385 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.522855 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.523515 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.524078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.524657 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.525015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.525348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.525677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.526016 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.526340 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.526759 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.527314 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.527896 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.528394 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.528921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.529372 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.529717 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.530048 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.530466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.530903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.531249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.531694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.532080 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.532423 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.532750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.533253 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.533795 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.534374 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.535151 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.535894 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.536650 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.537161 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.537483 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.537961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.538437 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.539485 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.540539 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.541090 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.541486 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.541891 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.549596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.549596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.549596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.549596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.549596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.549596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.549596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.549596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.550865 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.550865 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.550865 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.550865 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.553412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.554278 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.555715 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.556535 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.557148 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.557797 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.558432 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.559078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.559607 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.560251 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.560921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.561559 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.562422 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.563146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.563906 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.564532 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.565169 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.565813 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.566447 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.567100 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.567669 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.568356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.568981 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.569456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.569899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.571093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.571591 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.572115 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.572858 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.574269 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.578380 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.579351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.580147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.581005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.581828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.582686 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.583672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.584303 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.584919 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.585561 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.586105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.586612 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.587149 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.587771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.588442 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.589171 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.590162 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.590653 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.591140 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.591630 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.592097 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.593338 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.594054 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.595424 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.596060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.596685 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.597475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.597976 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.598475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.599001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.599534 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.600036 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.600530 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.601044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.602143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.602698 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.603544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.604132 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.604761 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.605335 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.605878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.606424 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.606960 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.608307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.608307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.608743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.609257 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.609752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.610251 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.610847 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.611347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.611712 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 06:15:42.612528 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.612852 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 06:15:42.612852 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 06:15:42.613295 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.613739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 06:15:42.613739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 06:15:42.613739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.614963 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.615898 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.616127 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.616127 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.616553 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.616764 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.616764 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.616764 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.617415 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.617704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.617704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.618299 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.618526 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.618526 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.618526 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-3-iscsi {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.619188 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.619364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.619364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.619364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.619959 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.620187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.620187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.620187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.620187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.620875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.621067 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.621067 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.621067 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.621710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.621710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.622109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.622282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.622612 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.622978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.623584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.624241 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.624767 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.624982 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.625210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-3-iscsi {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.627237 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.627237 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.627640 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.627640 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.628151 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.628388 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.628388 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.628784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.628991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.629187 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.629380 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.629380 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.629771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.629971 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.629971 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.630311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.630508 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.630508 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.630508 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.630508 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.631308 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.631500 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.631689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.631689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.632080 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.632272 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.632272 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.633220 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.633436 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.633436 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.633814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.634007 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.634007 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.634378 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.634603 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.634603 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.635281 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.635470 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.636443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.636443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.636783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.636973 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.637439 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.637596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.637596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.637596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.638044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.638212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.638212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.638497 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.638676 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.638676 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.639111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.639305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.639305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.640587 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.640800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.641016 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.641506 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.641506 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.642013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.642267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.642267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.642781 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.643202 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.643202 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.643899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.644144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.644144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.644529 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.644735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.644735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.644735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.645518 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.645715 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.645715 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.646109 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.646311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.646311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.646805 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.682021 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.682021 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.682601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.682945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.682945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.683643 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.683998 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.683998 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.684474 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.684739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.684739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.686133 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.686411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.686411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.686946 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.687240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.687240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.687695 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.687953 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.688191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.688425 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.688425 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.688923 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.689172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.689172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.689660 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.689927 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.690170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.690371 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.690686 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.691701 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.692421 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.692753 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.693168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.693485 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.693915 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.694221 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.694475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.694978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.696380 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.696819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.697071 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.697322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.697642 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.697970 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.698184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.698486 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.698885 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.699148 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.699384 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.699736 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.699967 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.700201 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.700470 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.700707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.700960 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.701367 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.701610 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.701913 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.702238 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.702518 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.702778 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.703096 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.703335 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.703595 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.703934 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.704208 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.704382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.704599 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.704803 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.705154 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.705360 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.705670 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.705918 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.707308 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.707685 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.707973 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.708227 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.708446 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.708686 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.708939 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.709178 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.709526 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.709800 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.710117 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.710370 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.711001 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.711283 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.711527 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.711745 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.711967 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.712185 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.712415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.712685 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.712917 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.713146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.713376 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 06:15:42.713590 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.713811 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.714072 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.714331 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.714584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.714991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.715228 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.715509 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.715750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.715987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.716315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.717459 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.717689 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.717926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.718186 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.718186 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.718668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.718668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.719113 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.719404 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.720565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.720802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.721011 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.721256 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.721466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.721721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.721926 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.721926 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.722415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.722680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.722890 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.723161 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.723420 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.723702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.723967 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.724385 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.724591 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.724813 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.725027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.725313 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.725578 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.725832 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.726083 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.726487 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.727795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.727960 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.728109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.728295 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.728469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.728615 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.728615 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.728978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.729202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.729356 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.729563 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.729752 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.729948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.730139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.730294 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.730439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.730584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.730780 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.730938 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.731152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.731302 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.731476 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.731670 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.731862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.732014 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.732159 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.732310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.732455 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.732666 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.732865 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.733029 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.733181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.733333 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.733502 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.733654 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.733837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.733989 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.734177 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.734388 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.734554 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.734735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.734924 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.735082 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.735267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.735420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.735604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.735815 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.736038 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.736218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.736409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.736560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.736745 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.736907 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.737194 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.737452 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.737956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.738140 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.738296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.738511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.738754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.738938 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.739139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.739139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.739139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.739669 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.739669 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.739669 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.739669 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.740278 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.740278 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.740573 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.740725 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.740725 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.741057 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.741057 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.741346 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.741499 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.741499 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.741814 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.742513 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.742781 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.743081 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.743081 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.743615 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.743871 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.744109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.744405 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.744624 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.744788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.744980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.745145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.745326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.745529 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.745734 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.745918 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.746065 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.746244 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.746403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.746639 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.746860 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.747023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.747199 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.747460 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.747694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.748280 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.748483 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.748700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.748851 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.748974 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.749089 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.749287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.749404 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.749524 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.749673 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.749787 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.749941 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.750061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.750180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.750180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.750399 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.750513 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.750712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.756799 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.761007 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.761136 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.761720 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.761866 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.761980 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.762079 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.762496 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.762661 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.762661 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.762661 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.762938 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.763071 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.763211 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.763349 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.763490 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.763634 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.763771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.763903 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.764045 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.764183 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.764319 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.764460 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.764647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.764824 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.764824 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.765381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.765519 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.765664 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.765889 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.766027 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.766178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.766178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.766414 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.766705 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.766873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.767007 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.767130 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.767270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.767427 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.767565 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.767698 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.767848 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.767991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.768128 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.768264 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.768404 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.768544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.768711 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.768859 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.769006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.769142 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.769142 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.769594 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.769749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.769873 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.770001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.770136 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.770256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.770256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.770644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.771143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.771293 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.771410 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.771410 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.771635 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.771750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.771750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.772023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.772148 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.772148 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.772400 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.772523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.772639 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.772788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.772788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.773025 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.773547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.773547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.773984 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.774135 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.774135 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.774352 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.774504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.774674 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.774826 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.774826 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.775184 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.775314 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.775314 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.775575 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.775731 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.775878 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.776008 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.776008 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.776267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.776392 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.776538 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.776665 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.776665 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.776977 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.777143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.777143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.777410 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.777560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.777560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.777799 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.777939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.778095 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.778243 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.778366 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.778491 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.778491 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.778773 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.778932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.778932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.779169 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.779295 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.779295 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.779824 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.779990 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.780119 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.780246 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.780246 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.780537 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.780678 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.780678 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.781027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.781182 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.781302 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.781449 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.781449 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.781711 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.781850 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.781850 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.782123 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.782249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.782393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.782532 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.782532 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.782829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.782968 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.783110 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.783257 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.783257 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.783499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.783632 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.783632 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.783883 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784028 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784165 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784309 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784309 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784561 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.784960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.785956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.785956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.786179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.786316 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.786459 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.786459 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.786909 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.787039 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.787187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.787328 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.787457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.787587 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.787707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.787851 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.787851 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.788106 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.788233 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.788369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.788502 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.788502 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.788775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.788997 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.788997 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.789312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.789466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.789675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.789888 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.789888 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.790416 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.790558 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.790558 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.790854 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.791001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.791132 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.791277 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.791277 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.791517 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.791659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.791659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.791902 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.792030 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.792180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.792332 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.792332 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.792559 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.792704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.792704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.792975 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.793096 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.793233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.793376 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.793376 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.793614 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.793868 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.793868 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.794113 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.794251 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.794251 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.794845 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.795012 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.795163 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.795311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.795311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.795614 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.795759 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.795920 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.796064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.796064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.796314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.796463 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.796635 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.796785 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.796785 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.797150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.797313 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.797313 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.797616 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.797766 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.797928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.798062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.798062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.798335 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.798496 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.798496 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.798810 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.798956 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.798956 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.799226 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.799385 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.799543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.799717 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.799859 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.799986 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.799986 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.800292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.800292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.800577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.800577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.800919 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.801080 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.801080 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.801397 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.801542 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.801705 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.801868 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.801868 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.802162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.802303 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.802303 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.802303 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.802704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.802850 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.802850 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.803122 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.803278 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.803278 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.803574 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.803717 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.803865 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.804019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.804019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.804284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.805032 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.805201 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.805405 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.805405 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.805683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.806004 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.806004 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.806292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.806459 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.806459 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.806908 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.807118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.807317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.807504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.807504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.807878 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.808272 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.808272 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.808639 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.808838 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.808838 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.809210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.809599 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.809599 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.809938 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.810105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.810257 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.810424 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.810424 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.810750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.810933 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.811125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.811311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.811311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.811562 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.811679 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.811679 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.811997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.812187 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.812370 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.812370 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.812708 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.812708 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813040 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813204 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813375 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813561 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.813727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.815037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.815037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.815037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.815037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.815037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.815037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.815037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.815037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.816253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.816253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.816253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.816253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.816253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.816253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.816253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.816253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.817305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.817305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.817305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.817305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.817305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.817305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.817305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.817305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.818314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.818314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.818314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.818314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.818314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.818314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.818314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.818314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.819888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.819888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.819888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.819888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.819888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.819888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.819888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.819888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.821796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.821796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.821796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.821796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.821796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.821796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.821796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.821796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.822850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.822850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.822850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.822850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.822850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.822850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.822850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.822850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.823868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.823868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.823868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.823868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.823868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.823868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.823868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.823868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.825130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.825130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.825130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.825130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.825130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.825130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.825130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.825130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.826530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.826530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.826530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.826530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.826530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.826530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.826530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.826530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.827881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.827881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.827881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.827881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.827881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.827881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.827881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.827881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.829072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.829072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.829072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.829072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.829072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.829072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.829072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.829072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.830315 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.830315 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.830315 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.830315 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.830315 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.830315 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.830315 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.830315 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.831604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.831604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.831604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.831604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.831604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.831604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.831604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.831604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.832946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.832946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.832946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.832946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.832946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.832946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.832946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.832946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.834214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.834214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.834214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.834214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.834214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.834214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.834214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.834214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.835608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.835608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.835608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.835608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.835608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.835608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.835608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.835608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.837545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.837545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.837545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.837545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.837545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.837545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.837545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.837545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.838661 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.838869 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.839054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.839054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.839054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.839617 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.839804 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.839988 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.840156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.840156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.840156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.840156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.840156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.840156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.840156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.840156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.841393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.841393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.841393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.841393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.842060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.842248 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.842248 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.842596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.842818 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.843001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.843189 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.843189 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.843189 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.843718 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.843900 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.843900 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.844251 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.844462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.844462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.844844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.845051 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.845249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.845446 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.845644 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.845829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.846063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.846257 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.846257 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.846257 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.846257 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.846257 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.847266 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.847462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.847462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.847462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.847462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.848107 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.848286 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.848286 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.848643 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.848867 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.849087 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.849270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.849458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.849636 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.849827 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.850043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.850243 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.850434 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.850639 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.850827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.851019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.851270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.852006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.852221 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.852447 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.852661 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.852893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.853116 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.853323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.853470 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.853602 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.853738 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.853878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.854016 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.854016 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.854274 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.854403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.854403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.854689 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.854828 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.854998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.855136 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.855136 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.855398 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.855529 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.855664 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.855801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.855801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.856060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.856198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.856335 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.856464 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.856464 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.856717 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.856856 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.856994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.857122 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.857122 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.857374 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.857503 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.857503 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.857764 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.857893 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.858020 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.858176 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.858176 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.858464 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.858596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.858596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.858907 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.859042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.859170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.859311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.859311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.859311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.859684 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.859684 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.859935 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.860072 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.860209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.860209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.860451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.860580 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.860580 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.860830 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.860957 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.860957 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.860957 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.861341 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.861488 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.861488 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.861739 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.861874 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.862003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.862138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.862138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.862407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.862558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.862558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.862847 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.862986 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.862986 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.863231 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.863368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.863368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.863613 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.863752 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.863888 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.864024 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.864024 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.864445 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.864581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.864581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.864845 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.864976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.864976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.865228 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.865372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.865372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.865632 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.865761 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.865897 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.866044 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.866044 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.866336 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.866336 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.866586 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.866586 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.866959 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.867112 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.867296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.867505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.867505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.867982 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.868172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.868307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.868445 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.868586 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.868716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.868716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.868982 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.869112 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.869241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.869378 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.869507 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.869635 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.869772 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.869902 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.870039 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.870176 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.870305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.870441 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.870441 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.870713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.870863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.870995 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.871135 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.871311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.871450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.871596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.871746 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.871746 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.871994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.872139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.872310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.872448 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.872786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.873021 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.873306 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.873640 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.874167 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.874329 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.874478 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.874899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.875034 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.875375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.875585 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.875833 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.875997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.876281 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.876568 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.876750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.877110 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.877242 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.877566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.877700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.877893 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.878109 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.878249 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.878540 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.878772 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.878903 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.879050 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.879233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.879531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.879690 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.879854 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.880058 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.880207 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.880470 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.880602 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.880786 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.881008 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.881154 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.881437 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.881719 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.881946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.882143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.882347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.882347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.882844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.882844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.883245 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.883407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.883854 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.884018 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.884193 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.884414 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.884555 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.884810 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.884951 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.885126 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.885342 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.885483 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.885749 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.885889 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.886062 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.886283 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.886424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.886718 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.886866 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.887041 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.887274 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.887416 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.887654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.887784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.888014 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.888220 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.888367 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.888646 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.888778 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.888956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.889171 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.889319 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.889584 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.889751 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.889911 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.890198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.890330 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.890532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.890920 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.891245 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.891844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.892207 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.892550 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.892850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.893189 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.893506 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.894199 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.894497 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.894863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.895189 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.895510 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.895835 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.896212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.896476 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.896795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.897119 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.898028 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.898028 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.898943 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.899182 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.899393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.899605 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.899605 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.900000 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.900134 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.900134 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.900395 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.900558 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.900739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.900975 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.901128 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.901469 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.901652 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.902156 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.902421 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.902557 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.906754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.906754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.907060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.907060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 06:15:42.907320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.907320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.907320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.907320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.907320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.907320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.907320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.907320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.908469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.908469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.908469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.908469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.908469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.908469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.908469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.908469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.909881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.909881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.909881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.909881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.909881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.910820 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.910820 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.910820 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.911389 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.911389 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.911825 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.912029 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.912556 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.912715 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.912903 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.913215 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.913524 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.914892 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.915711 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.916264 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.916696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.916918 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.917244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.917561 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.917878 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.918197 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.918511 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.918925 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.919259 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.919738 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.920262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.920262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.920862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.920862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.921528 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.921528 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.922323 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.922323 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.923038 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.923038 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.923038 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.923624 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.923624 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.923981 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.924256 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.924672 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.925181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.925630 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.925960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.927585 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.927585 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.927585 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.928314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.928770 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.929116 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.929966 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.930299 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.930954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.931308 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.931638 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.931965 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.932291 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.932612 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.932944 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.933260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.933581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.933908 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.934235 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.934578 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.935132 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.935453 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.935798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.936131 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.936500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.937223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.937223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.937507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.937803 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.938123 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.938432 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 06:15:42.938793 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 06:15:42.981233 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO dbcounter [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Registered counter for database nova_api Aug 26 06:15:43.005676 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_db.sqlalchemy.engines [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:15:43.013344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writer thread running {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:15:43.076065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.context [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcc5be55-ca87-448b-b1ff-b5f0f867fd3d(cell1) {{(pid=121343) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 06:15:43.080705 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:15:43.081197 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:15:43.083520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:15:43.084580 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:15:43.085044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:15:43.087534 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:15:43.089721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO dbcounter [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Registered counter for database nova_cell0 Aug 26 06:15:43.094075 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO dbcounter [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Registered counter for database nova_cell1 Aug 26 06:15:43.103919 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_db.sqlalchemy.engines [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:15:43.105417 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_db.sqlalchemy.engines [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:15:43.105818 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO dbcounter [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Registered counter for database nova_api Aug 26 06:15:43.116517 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writer thread running {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:15:43.122380 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writer thread running {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:15:43.131473 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_db.sqlalchemy.engines [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:15:43.140339 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writer thread running {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:15:43.206613 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.context [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fcc5be55-ca87-448b-b1ff-b5f0f867fd3d(cell1) {{(pid=121344) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 06:15:43.211991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:15:43.212515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:15:43.215390 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:15:43.216161 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:15:43.216634 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:15:43.218831 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:15:43.220943 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO dbcounter [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Registered counter for database nova_cell0 Aug 26 06:15:43.225263 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO dbcounter [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Registered counter for database nova_cell1 Aug 26 06:15:43.234883 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_db.sqlalchemy.engines [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:15:43.236969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_db.sqlalchemy.engines [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:15:43.246494 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writer thread running {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:15:43.248049 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writer thread running {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:15:43.294186 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO dbcounter [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Registered counter for database nova_cell0 Aug 26 06:15:43.303363 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_db.sqlalchemy.engines [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:15:43.312826 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writer thread running {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:15:43.407202 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO dbcounter [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Registered counter for database nova_cell0 Aug 26 06:15:43.415737 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_db.sqlalchemy.engines [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 06:15:43.421203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writer thread running {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 06:15:43.682726 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: WARNING keystonemiddleware.auth_token [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 06:15:43.690323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: WARNING keystonemiddleware.auth_token [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 06:15:43.818008 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: WARNING keystonemiddleware.auth_token [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 06:15:43.831465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: WARNING keystonemiddleware.auth_token [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 06:15:44.087267 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: WARNING keystonemiddleware.auth_token [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 06:15:44.093934 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: WARNING keystonemiddleware.auth_token [None req-d11b7324-e724-4539-a069-4cb9f9cba108 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 06:15:44.099769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55efab9f59c0 pid: 121343 (default app) Aug 26 06:15:44.283909 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: WARNING keystonemiddleware.auth_token [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 06:15:44.290782 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: WARNING keystonemiddleware.auth_token [None req-3f31af1e-9074-4567-859c-2a685c947e00 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 06:15:44.296606 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55efab9f59c0 pid: 121344 (default app) Aug 26 06:16:23.656474 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=3 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:23.657966 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=3 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:23.659335 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=3 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:23.660882 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=3 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:23.918692 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=3 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:23.920152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=3 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:23.921271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=3 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:23.922473 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=3 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:25.194347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c4a2a581-e9d4-4b52-816c-d8a25cac40f3 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Action: 'create', calling method: .version_select at 0x7f2f0a0409d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1577427314"}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:25.504512 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e2bb2e08-b3bc-4c87-a711-4551274f34ac tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] Action: 'create', calling method: .version_select at 0x7f2f09ffca60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1550600151", "metadata": {"Type": "work"}}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:29.001608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e2bb2e08-b3bc-4c87-a711-4551274f34ac tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 5.088954 Aug 26 06:16:29.014135 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 26 06:16:23 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 5101 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 06:16:29.051058 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-eb30f401-bbe2-46dd-82d2-1e9572a2eb77 tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] Calling method '.version_select at 0x7f2f09ed1790>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:29.064555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c4a2a581-e9d4-4b52-816c-d8a25cac40f3 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 5.422097 Aug 26 06:16:29.065931 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 1/2] 10.222.0.40 () {60 vars in 1155 bytes} [Fri Aug 26 06:16:23 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 5425 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 26 06:16:29.099046 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7d2adb49-3224-4afe-9c87-e22263477e7e tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09f19820>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:29.370450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-eb30f401-bbe2-46dd-82d2-1e9572a2eb77 tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947" status: 200 len: 353 microversion: 2.1 time: 0.354944 Aug 26 06:16:29.390809 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:29 2022] GET /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947 => generated 353 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:29.538690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7d2adb49-3224-4afe-9c87-e22263477e7e tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6" status: 200 len: 345 microversion: 2.1 time: 0.451280 Aug 26 06:16:29.548591 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:29 2022] GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6 => generated 345 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:30.394162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-185ceeea-bd2e-409a-94ce-f28419b12feb tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] Calling method '.version_select at 0x7f2f09ed1af0>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:30.522559 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-185ceeea-bd2e-409a-94ce-f28419b12feb tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947" status: 200 len: 354 microversion: 2.1 time: 0.136784 Aug 26 06:16:30.523829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 3/5] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:30 2022] GET /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947 => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:30.539451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e6e0a4ce-16b2-4f40-99ec-6ad537038a8d tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] Calling method '.version_select at 0x7f2f09f19ee0>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:30.566303 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-45c66d01-0a08-4caf-a58a-9248e2d33be0 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09ee11f0>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:30.646164 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e6e0a4ce-16b2-4f40-99ec-6ad537038a8d tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947" status: 200 len: 354 microversion: 2.1 time: 0.114027 Aug 26 06:16:30.646687 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 3/6] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:30 2022] GET /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947 => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:16:30.663844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e56821d0-6a0a-4bae-b82e-6393ff0e5282 tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] Calling method '.version_select at 0x7f2f09f2f670>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:30.726273 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-45c66d01-0a08-4caf-a58a-9248e2d33be0 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6" status: 200 len: 346 microversion: 2.1 time: 0.173226 Aug 26 06:16:30.727385 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:30 2022] GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6 => generated 346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:30.746257 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2e1671d3-c112-4667-8db3-4a18f7fe4b27 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Action: 'create', calling method: .version_select at 0x7f2f09ee18b0>, body: {"snapshot": {"volume_id": "f728bf95-7a4c-4d8e-a172-682a108301c6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-969408382"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:31.103964 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e56821d0-6a0a-4bae-b82e-6393ff0e5282 tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947" status: 202 len: 0 microversion: 2.1 time: 0.444429 Aug 26 06:16:31.108975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 06:16:30 2022] DELETE /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:16:31.115083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-df91524e-f686-4357-ba8e-af1d5c4ceb1f tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] Calling method '.version_select at 0x7f2f09f19d30>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:31.456678 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-df91524e-f686-4357-ba8e-af1d5c4ceb1f tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947" status: 200 len: 353 microversion: 2.1 time: 0.343474 Aug 26 06:16:31.459160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 5/9] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:31 2022] GET /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947 => generated 353 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:32.456426 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2e1671d3-c112-4667-8db3-4a18f7fe4b27 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.715879 Aug 26 06:16:32.457266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 5/10] 10.222.0.40 () {60 vars in 1162 bytes} [Fri Aug 26 06:16:30 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:16:32.479343 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-424da637-70cd-4aea-9bb5-7d9fecf57cc7 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09ee1dc0>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:32.491236 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-74acbf7a-9ada-4fcb-a05b-0a67be376fde tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] Calling method '.version_select at 0x7f2f0a040dc0>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:32.614282 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-74acbf7a-9ada-4fcb-a05b-0a67be376fde tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] HTTP exception thrown: Volume e0420c22-7afc-4169-a083-b4b1960de947 could not be found. Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-74acbf7a-9ada-4fcb-a05b-0a67be376fde tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] Request method failure captured: Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947 HTTP/1.1 Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGU3r_ZP2ogyACWI3Zo7qMbH-0vzVmrmDHqicGXWi_OrDQk6Kx_AiHjtfK08zFOpfi_LFUoYsP4ueuSZonD5hWTev_WtJzfHa3VtZYriAu33502tHYtmrVF43_DLrlWrOtNhAw7CS83B9rLd6JBsnB-Z4Vyyv7I4RotSZFzpaRKRM10 Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: c55c4050ef494e8f914271798c0e901b Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-VolumesGetTestJSON-1707982685 Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:16:32.620788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c55c4050ef494e8f914271798c0e901b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55c4050ef494e8f914271798c0e901b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c55c4050ef494e8f914271798c0e901b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c55c4050ef494e8f914271798c0e901b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-VolumesGetTestJSON-1707982685 Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: c55c4050ef494e8f914271798c0e901b Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-VolumesGetTestJSON-1707982685 Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-VolumesGetTestJSON-1707982685-project Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 6c1aacb78343435aa348e148a7605b18 Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-VolumesGetTestJSON-1707982685-project Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Volume e0420c22-7afc-4169-a083-b4b1960de947 could not be found. Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'e0420c22-7afc-4169-a083-b4b1960de947'} Aug 26 06:16:32.621991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e0420c22-7afc-4169-a083-b4b1960de947 could not be found. (HTTP 404) (Request-ID: req-607a617c-d0f2-4eae-b701-51e5216f053e) Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:32.622605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 06:16:32.623509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e0420c22-7afc-4169-a083-b4b1960de947 could not be found. Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 06:16:32.626792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:16:32.629034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e0420c22-7afc-4169-a083-b4b1960de947 could not be found. Aug 26 06:16:32.629034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:32.629034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:32.629034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:32.629034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:32.629034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:32.629034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:32.629034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:16:32.629034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:16:32.629034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e0420c22-7afc-4169-a083-b4b1960de947 could not be found. Aug 26 06:16:32.629034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:32.632061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-74acbf7a-9ada-4fcb-a05b-0a67be376fde tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] Returning 404 to user: Volume e0420c22-7afc-4169-a083-b4b1960de947 could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:16:32.633347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-74acbf7a-9ada-4fcb-a05b-0a67be376fde tempest-VolumesGetTestJSON-1707982685 tempest-VolumesGetTestJSON-1707982685-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947" status: 404 len: 109 microversion: 2.1 time: 0.169077 Aug 26 06:16:32.637250 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 6/11] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:32 2022] GET /compute/v2.1/os-volumes/e0420c22-7afc-4169-a083-b4b1960de947 => generated 109 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:16:32.730146 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-424da637-70cd-4aea-9bb5-7d9fecf57cc7 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d" status: 200 len: 286 microversion: 2.1 time: 0.259426 Aug 26 06:16:32.732528 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 06:16:32 2022] GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d => generated 286 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:32.744623 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a22d1c73-965f-4fcb-b8af-08489552a213 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09f2f550>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:32.861470 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a22d1c73-965f-4fcb-b8af-08489552a213 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.121862 Aug 26 06:16:32.862353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1140 bytes} [Fri Aug 26 06:16:32 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:32.875314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-083e6201-0d87-4022-b31a-eb5ef7ed2dc4 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09ee14c0>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:32.957541 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-083e6201-0d87-4022-b31a-eb5ef7ed2dc4 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d" status: 200 len: 286 microversion: 2.1 time: 0.087156 Aug 26 06:16:32.958339 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 7/14] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 06:16:32 2022] GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:33.970132 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0320fb75-34e3-47ab-b143-c6612f4355f6 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09ea0160>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:34.065801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0320fb75-34e3-47ab-b143-c6612f4355f6 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d" status: 200 len: 286 microversion: 2.1 time: 0.100018 Aug 26 06:16:34.067036 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 8/15] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 06:16:33 2022] GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:35.080688 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3d3301a8-e0ed-41da-a841-ae316b4c64b2 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09ed1dc0>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:35.166152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3d3301a8-e0ed-41da-a841-ae316b4c64b2 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d" status: 200 len: 286 microversion: 2.1 time: 0.089823 Aug 26 06:16:35.167283 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 06:16:35 2022] GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:36.180918 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-86e1f635-ac33-4c6a-8f59-4cd8fcdb689d tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09e9a940>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:36.227864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-86e1f635-ac33-4c6a-8f59-4cd8fcdb689d tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d" status: 200 len: 287 microversion: 2.1 time: 0.050240 Aug 26 06:16:36.228056 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 9/17] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 06:16:36 2022] GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:36.240353 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8625e855-a013-4821-bdaa-2a9cf28ff895 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09ee1430>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:36.606987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8625e855-a013-4821-bdaa-2a9cf28ff895 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d" status: 202 len: 0 microversion: 2.1 time: 0.371567 Aug 26 06:16:36.608438 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 9/18] 10.222.0.40 () {58 vars in 1254 bytes} [Fri Aug 26 06:16:36 2022] DELETE /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 06:16:36.617676 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4cd345ad-edb5-4ea8-bb85-36a7f13dc035 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09ee1ca0>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:36.664579 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4cd345ad-edb5-4ea8-bb85-36a7f13dc035 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d" status: 200 len: 286 microversion: 2.1 time: 0.051808 Aug 26 06:16:36.665473 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 10/19] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 06:16:36 2022] GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:37.062873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b8e732c8-228f-4175-a41e-c00218e0a25d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Action: 'create', calling method: .version_select at 0x7f2f09e9a0d0>, body: {"keypair": {"name": "tempest-keypair-327008289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU91AHNOsrCuruK3V/grQdcldsMaxrZhwUmKXYgRjqpld5k0Zd48J480zTmJWVMfMff890IGsGbrU39UVS4fEIdyNDPaXcSPRRWyNlB5DbLjKg+L9O7UBGpP2ChANpuNA=="}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:37.166677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-b8e732c8-228f-4175-a41e-c00218e0a25d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Getting quotas for project aceecfa04cf941348d542c3e55569384. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:16:37.192619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-b8e732c8-228f-4175-a41e-c00218e0a25d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Getting quotas for user 1d22ea3fb8fa4bd99537fb83279b2d24 and project aceecfa04cf941348d542c3e55569384. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:16:37.379887 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b8e732c8-228f-4175-a41e-c00218e0a25d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.891837 Aug 26 06:16:37.380473 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 10/20] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 06:16:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:16:37.678796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b8f97fc4-521e-4bfc-9c72-316a4b472b67 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09ed18b0>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:37.785038 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-b8f97fc4-521e-4bfc-9c72-316a4b472b67 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] HTTP exception thrown: Snapshot 54407fa3-a604-49ba-a10e-90cd7bbb013d could not be found. Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b8f97fc4-521e-4bfc-9c72-316a4b472b67 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Request method failure captured: Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d HTTP/1.1 Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGU3ogWmRNt3De8VYoCQ383J6sxfWH149-7tpYafehb-tqou5edetknLVcDPUsp5e4UZVNFmRZGv_d-gCK0NmLSRsDCAGvj27eHunAzed7fMppOBL7C60dd1mqAT00ZCn_HnDKdUpKyreVdqS_czmxkZ3RnqCYu8Lp3sL5cbyY5nICw Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: bdfe27a09bb6426a84d193f9dda3c43f Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:16:37.791060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: bdfe27a09bb6426a84d193f9dda3c43f Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-VolumesSnapshotsTestJSON-1735536797-project Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: b7aeee13c8a84f0aa29f9190680745c9 Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1735536797-project Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Snapshot 54407fa3-a604-49ba-a10e-90cd7bbb013d could not be found. Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '54407fa3-a604-49ba-a10e-90cd7bbb013d'} Aug 26 06:16:37.792266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 54407fa3-a604-49ba-a10e-90cd7bbb013d could not be found. (HTTP 404) (Request-ID: req-85289b02-6ba7-4a92-891c-e866c9d4ca0e) Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:37.793012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 06:16:37.794000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 54407fa3-a604-49ba-a10e-90cd7bbb013d could not be found. Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 26 06:16:37.795152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 54407fa3-a604-49ba-a10e-90cd7bbb013d could not be found. Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 54407fa3-a604-49ba-a10e-90cd7bbb013d could not be found. Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b8f97fc4-521e-4bfc-9c72-316a4b472b67 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Returning 404 to user: Snapshot 54407fa3-a604-49ba-a10e-90cd7bbb013d could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:16:37.796279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b8f97fc4-521e-4bfc-9c72-316a4b472b67 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d" status: 404 len: 111 microversion: 2.1 time: 0.118876 Aug 26 06:16:37.803226 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5d7b03c1-8dc0-476f-86f0-82a5490eb85d tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09e065e0>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:37.809143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 11/21] 10.222.0.40 () {58 vars in 1251 bytes} [Fri Aug 26 06:16:37 2022] GET /compute/v2.1/os-snapshots/54407fa3-a604-49ba-a10e-90cd7bbb013d => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:16:38.211505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5d7b03c1-8dc0-476f-86f0-82a5490eb85d tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6" status: 202 len: 0 microversion: 2.1 time: 0.406460 Aug 26 06:16:38.211505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 11/22] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 06:16:37 2022] DELETE /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:16:38.228509 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b0d4ed57-dd95-470e-af06-9f2eecaa1bce tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09e4f1f0>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:38.303969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b0d4ed57-dd95-470e-af06-9f2eecaa1bce tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6" status: 200 len: 345 microversion: 2.1 time: 0.079010 Aug 26 06:16:38.304547 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:38 2022] GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:39.026691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1452413882", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:39.071765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1442526734", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "networks": [{"uuid": "504e79cb-f4bc-488f-be6a-9ade8ca0c470"}]}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:39.163351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.network.neutron [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] validate_networks() for [('f4400288-0fd6-4a35-b08d-549e7c7c455e', None, None, None, None, None)] {{(pid=121343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:16:39.284496 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] validate_networks() for [('504e79cb-f4bc-488f-be6a-9ade8ca0c470', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:16:41.279222 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:16:41.279965 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:16:41.280459 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:16:41.283260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:16:41.283260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:16:41.316618 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:41.317231 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:41.317892 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:41.319113 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:41.321428 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:41.322171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:41.366899 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Getting quotas for project bf6936f23aa446008e8119807ec8724d. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:16:41.390202 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Getting quotas for user a7b7684d766542b097b88d642114023b and project bf6936f23aa446008e8119807ec8724d. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:16:41.457208 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:16:41.462891 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:16:41.832964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9fb1301c-46a6-42ce-b951-0eb88d32312d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.052140 Aug 26 06:16:41.843474 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 13/24] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:16:41.849813 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-caba0d64-db49-4c42-ace3-2bcb951e8640 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f0954f550>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:41.968206 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Flavor limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:16:41.968782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Image limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:16:41.974729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Flavor pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:16:41.974729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Image pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:16:41.974729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:16:41.990707 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:41.991497 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:41.992440 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:41.993695 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:41.994543 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:41.995404 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:42.060074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Getting quotas for project 84a2eee4447b4eadb79fbdbb874d4476. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:16:42.069699 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Getting quotas for user 8d154e96376a49918658b0c340c722e9 and project 84a2eee4447b4eadb79fbdbb874d4476. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:16:42.097493 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Going to run 1 instances... {{(pid=121343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:16:42.105409 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:16:42.258283 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-caba0d64-db49-4c42-ace3-2bcb951e8640 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] HTTP exception thrown: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-caba0d64-db49-4c42-ace3-2bcb951e8640 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Request method failure captured: Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6 HTTP/1.1 Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGU3ogWmRNt3De8VYoCQ383J6sxfWH149-7tpYafehb-tqou5edetknLVcDPUsp5e4UZVNFmRZGv_d-gCK0NmLSRsDCAGvj27eHunAzed7fMppOBL7C60dd1mqAT00ZCn_HnDKdUpKyreVdqS_czmxkZ3RnqCYu8Lp3sL5cbyY5nICw Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: bdfe27a09bb6426a84d193f9dda3c43f Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:16:42.260954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: bdfe27a09bb6426a84d193f9dda3c43f Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-VolumesSnapshotsTestJSON-1735536797-project Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: b7aeee13c8a84f0aa29f9190680745c9 Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1735536797-project Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'f728bf95-7a4c-4d8e-a172-682a108301c6'} Aug 26 06:16:42.262224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. (HTTP 404) (Request-ID: req-78caee64-d9bd-407e-a3e1-0beb135f41d2) Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:42.263043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 06:16:42.264145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 06:16:42.265255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-caba0d64-db49-4c42-ace3-2bcb951e8640 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Returning 404 to user: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-caba0d64-db49-4c42-ace3-2bcb951e8640 tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6" status: 404 len: 109 microversion: 2.1 time: 0.426126 Aug 26 06:16:42.266369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 14/25] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:41 2022] GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6 => generated 109 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:16:42.285097 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1a0b188c-08b7-41c7-ae95-fcebf14dedd8 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:42.289772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1a0b188c-08b7-41c7-ae95-fcebf14dedd8 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:42.384937 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f7472988-0c6e-4f7c-88da-454f0f7c13eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.065449 Aug 26 06:16:42.392172 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 12/26] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:16:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 4073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:16:42.398301 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a2ebf221-f7c4-4032-8b17-2ec25a81127b tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f09d3eb80>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:42.556071 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1a0b188c-08b7-41c7-ae95-fcebf14dedd8 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:42.581190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1a0b188c-08b7-41c7-ae95-fcebf14dedd8 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1215 microversion: 2.1 time: 0.315117 Aug 26 06:16:42.595282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 15/27] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:42 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1215 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:42.620344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c59f166d-9c21-470f-bd72-3276b621a1aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:42.621743 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c59f166d-9c21-470f-bd72-3276b621a1aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:42.749294 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-a2ebf221-f7c4-4032-8b17-2ec25a81127b tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] HTTP exception thrown: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a2ebf221-f7c4-4032-8b17-2ec25a81127b tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Request method failure captured: Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: DELETE /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6 HTTP/1.1 Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGU3ogWmRNt3De8VYoCQ383J6sxfWH149-7tpYafehb-tqou5edetknLVcDPUsp5e4UZVNFmRZGv_d-gCK0NmLSRsDCAGvj27eHunAzed7fMppOBL7C60dd1mqAT00ZCn_HnDKdUpKyreVdqS_czmxkZ3RnqCYu8Lp3sL5cbyY5nICw Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: bdfe27a09bb6426a84d193f9dda3c43f Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:16:42.753873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: bdfe27a09bb6426a84d193f9dda3c43f Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-VolumesSnapshotsTestJSON-1735536797-project Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: b7aeee13c8a84f0aa29f9190680745c9 Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1735536797-project Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'f728bf95-7a4c-4d8e-a172-682a108301c6'} Aug 26 06:16:42.755123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. (HTTP 404) (Request-ID: req-9cc80673-d256-4926-91c5-74d9aa27e5d3) Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:42.755973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 06:16:42.756962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 06:16:42.758042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:16:42.760353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:42.760353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.760353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:42.760353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.760353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:42.760353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:42.760353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:42.760353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:16:42.760353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:16:42.760353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:42.760353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:42.767327 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a2ebf221-f7c4-4032-8b17-2ec25a81127b tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Returning 404 to user: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:16:42.768616 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a2ebf221-f7c4-4032-8b17-2ec25a81127b tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6" status: 404 len: 109 microversion: 2.1 time: 0.374669 Aug 26 06:16:42.769266 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 13/28] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 06:16:42 2022] DELETE /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6 => generated 109 bytes in 376 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:16:42.779606 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1185963025", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d86ecc4-b89c-4670-82c2-e19913819bab"}], "security_groups": [{"name": "tempest-securitygroup--869125084"}], "key_name": "tempest-keypair-327008289", "user_data": "}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:43.094980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c59f166d-9c21-470f-bd72-3276b621a1aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:43.107138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c59f166d-9c21-470f-bd72-3276b621a1aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1222 microversion: 2.1 time: 0.521203 Aug 26 06:16:43.109756 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 16/29] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:42 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1222 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:43.126316 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-cad27dab-9840-4e05-abcb-f60dbdc8071b tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Calling method '.version_select at 0x7f2f0956e9d0>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:43.213748 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.network.neutron [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] validate_networks() for [('9d86ecc4-b89c-4670-82c2-e19913819bab', None, None, None, None, None)] {{(pid=121343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:16:43.331904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-cad27dab-9840-4e05-abcb-f60dbdc8071b tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] HTTP exception thrown: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-cad27dab-9840-4e05-abcb-f60dbdc8071b tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Request method failure captured: Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6 HTTP/1.1 Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGU3ogWmRNt3De8VYoCQ383J6sxfWH149-7tpYafehb-tqou5edetknLVcDPUsp5e4UZVNFmRZGv_d-gCK0NmLSRsDCAGvj27eHunAzed7fMppOBL7C60dd1mqAT00ZCn_HnDKdUpKyreVdqS_czmxkZ3RnqCYu8Lp3sL5cbyY5nICw Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: bdfe27a09bb6426a84d193f9dda3c43f Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:16:43.332798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bdfe27a09bb6426a84d193f9dda3c43f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: bdfe27a09bb6426a84d193f9dda3c43f Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1735536797 Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-VolumesSnapshotsTestJSON-1735536797-project Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: b7aeee13c8a84f0aa29f9190680745c9 Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1735536797-project Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'f728bf95-7a4c-4d8e-a172-682a108301c6'} Aug 26 06:16:43.334490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. (HTTP 404) (Request-ID: req-17f0a42c-cabf-437b-9641-30a7869cc909) Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:43.335796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 06:16:43.337560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 06:16:43.343403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-cad27dab-9840-4e05-abcb-f60dbdc8071b tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] Returning 404 to user: Volume f728bf95-7a4c-4d8e-a172-682a108301c6 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-cad27dab-9840-4e05-abcb-f60dbdc8071b tempest-VolumesSnapshotsTestJSON-1735536797 tempest-VolumesSnapshotsTestJSON-1735536797-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6" status: 404 len: 109 microversion: 2.1 time: 0.223338 Aug 26 06:16:43.346463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 17/30] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:43 2022] GET /compute/v2.1/os-volumes/f728bf95-7a4c-4d8e-a172-682a108301c6 => generated 109 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:16:43.449286 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1420113713", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:43.587072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] validate_networks() for [('f4400288-0fd6-4a35-b08d-549e7c7c455e', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:16:44.826277 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:16:44.827544 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:16:44.828296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:16:44.829256 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:16:44.837850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:16:44.864867 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:44.865646 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:44.868002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:44.868980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:44.871323 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:44.872002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:44.916695 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Getting quotas for project 84a2eee4447b4eadb79fbdbb874d4476. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:16:44.922710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Getting quotas for user 8d154e96376a49918658b0c340c722e9 and project 84a2eee4447b4eadb79fbdbb874d4476. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:16:44.944619 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:16:44.956914 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:16:45.040362 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Flavor limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:16:45.041245 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Image limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:16:45.041828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Flavor pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:16:45.042722 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Image pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:16:45.043147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:16:45.063570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:45.063570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:45.063965 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:45.064774 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:45.065489 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:45.066170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:45.109452 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Getting quotas for project aceecfa04cf941348d542c3e55569384. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:16:45.118670 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Getting quotas for user 1d22ea3fb8fa4bd99537fb83279b2d24 and project aceecfa04cf941348d542c3e55569384. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:16:45.167871 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Going to run 1 instances... {{(pid=121343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:16:45.174058 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:16:45.254527 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e6b9bfa6-b7f7-4081-a879-b8eb2cf81684 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.811560 Aug 26 06:16:45.257501 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 18/31] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:16:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:16:45.269829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5afec5f2-5db0-4a0a-8eb1-3c9360ab281b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:45.273357 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5afec5f2-5db0-4a0a-8eb1-3c9360ab281b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:45.426579 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5afec5f2-5db0-4a0a-8eb1-3c9360ab281b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:45.450041 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5afec5f2-5db0-4a0a-8eb1-3c9360ab281b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1215 microversion: 2.1 time: 0.190754 Aug 26 06:16:45.451291 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 19/32] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:45 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:45.458418 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6df458ee-578f-48ae-b94d-78bf58d88643 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] Calling method '.version_select at 0x7f2f0956eb80>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:45.483757 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-16636ebc-f1e9-417f-b221-a16a47bb3a39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.712459 Aug 26 06:16:45.492978 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 14/33] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:16:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 2723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:16:45.504959 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8489d139-9d85-4734-aa5d-da686423b524 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:45.505582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8489d139-9d85-4734-aa5d-da686423b524 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:45.553748 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6df458ee-578f-48ae-b94d-78bf58d88643 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/02bc236a-bbff-45d1-b5d0-f6aa7d1db494" status: 200 len: 351 microversion: 2.1 time: 0.100979 Aug 26 06:16:45.554867 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 20/34] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:45 2022] GET /compute/v2.1/os-volumes/02bc236a-bbff-45d1-b5d0-f6aa7d1db494 => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:45.562339 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d0f678a8-2590-4f26-a572-78daeedb3df6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:45.563977 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d0f678a8-2590-4f26-a572-78daeedb3df6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:45.642353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8489d139-9d85-4734-aa5d-da686423b524 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:45.684682 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8489d139-9d85-4734-aa5d-da686423b524 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1222 microversion: 2.1 time: 0.190072 Aug 26 06:16:45.700135 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 15/35] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:45 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1222 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:45.705986 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d0f678a8-2590-4f26-a572-78daeedb3df6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:45.720987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d0f678a8-2590-4f26-a572-78daeedb3df6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1237 microversion: 2.1 time: 0.164389 Aug 26 06:16:45.722787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 21/36] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:45 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1237 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:46.474247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-495b1a08-7677-420a-a2f0-91fd6284fcde tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:46.476383 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-495b1a08-7677-420a-a2f0-91fd6284fcde tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:46.491494 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-495b1a08-7677-420a-a2f0-91fd6284fcde tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:46.492360 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-495b1a08-7677-420a-a2f0-91fd6284fcde tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:46.492968 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-495b1a08-7677-420a-a2f0-91fd6284fcde tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:46.510974 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-495b1a08-7677-420a-a2f0-91fd6284fcde tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:46.527920 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-495b1a08-7677-420a-a2f0-91fd6284fcde tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:46.535762 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-495b1a08-7677-420a-a2f0-91fd6284fcde tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:46.692773 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-495b1a08-7677-420a-a2f0-91fd6284fcde tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:46.706444 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-495b1a08-7677-420a-a2f0-91fd6284fcde tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1219 microversion: 2.1 time: 0.237281 Aug 26 06:16:46.707259 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 16/37] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:46 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1219 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:46.710948 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b672b2e2-1ddc-446b-810e-0efbb05943bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:46.710948 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b672b2e2-1ddc-446b-810e-0efbb05943bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:46.762560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-28a2f670-8a1c-4fa2-9e6d-1034a97391b2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:46.763694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-28a2f670-8a1c-4fa2-9e6d-1034a97391b2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:46.825415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b672b2e2-1ddc-446b-810e-0efbb05943bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:46.832568 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b672b2e2-1ddc-446b-810e-0efbb05943bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1222 microversion: 2.1 time: 0.127213 Aug 26 06:16:46.847981 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 22/38] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:46 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:46.863292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-28a2f670-8a1c-4fa2-9e6d-1034a97391b2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:46.872107 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-28a2f670-8a1c-4fa2-9e6d-1034a97391b2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1237 microversion: 2.1 time: 0.119289 Aug 26 06:16:46.872606 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 17/39] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:46 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1237 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:47.733963 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7b3e77b1-892d-48c5-94e6-1eb89bd3b7ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:47.734693 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7b3e77b1-892d-48c5-94e6-1eb89bd3b7ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:47.756466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7b3e77b1-892d-48c5-94e6-1eb89bd3b7ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:47.761843 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7b3e77b1-892d-48c5-94e6-1eb89bd3b7ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:47.768641 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7b3e77b1-892d-48c5-94e6-1eb89bd3b7ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:47.770413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7b3e77b1-892d-48c5-94e6-1eb89bd3b7ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:47.771165 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7b3e77b1-892d-48c5-94e6-1eb89bd3b7ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:47.771871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7b3e77b1-892d-48c5-94e6-1eb89bd3b7ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:47.853708 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3417a1f7-31dc-4555-9c92-26ffb9b1ed2c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:47.854442 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3417a1f7-31dc-4555-9c92-26ffb9b1ed2c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:47.872028 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3417a1f7-31dc-4555-9c92-26ffb9b1ed2c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:47.872687 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3417a1f7-31dc-4555-9c92-26ffb9b1ed2c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:47.873350 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3417a1f7-31dc-4555-9c92-26ffb9b1ed2c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:47.878248 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3417a1f7-31dc-4555-9c92-26ffb9b1ed2c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:47.878248 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3417a1f7-31dc-4555-9c92-26ffb9b1ed2c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:47.878248 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3417a1f7-31dc-4555-9c92-26ffb9b1ed2c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:47.958945 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3417a1f7-31dc-4555-9c92-26ffb9b1ed2c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:47.969393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7b3e77b1-892d-48c5-94e6-1eb89bd3b7ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:48.011946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7b3e77b1-892d-48c5-94e6-1eb89bd3b7ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1267 microversion: 2.1 time: 0.282686 Aug 26 06:16:48.019640 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3417a1f7-31dc-4555-9c92-26ffb9b1ed2c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1218 microversion: 2.1 time: 0.155146 Aug 26 06:16:48.023696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 23/40] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:47 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:48.034682 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f6fef179-3711-43e3-b752-adc7114a3af6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:48.036105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 18/41] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:47 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:48.047688 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f6fef179-3711-43e3-b752-adc7114a3af6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:48.077192 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6fef179-3711-43e3-b752-adc7114a3af6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:48.077702 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6fef179-3711-43e3-b752-adc7114a3af6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:48.078150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6fef179-3711-43e3-b752-adc7114a3af6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:48.078924 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6fef179-3711-43e3-b752-adc7114a3af6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:48.079394 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6fef179-3711-43e3-b752-adc7114a3af6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:48.083269 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6fef179-3711-43e3-b752-adc7114a3af6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:48.140426 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cc870ff5-e227-4d7b-a359-70d0063e14d1 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] Calling method '.version_select at 0x7f2f094861f0>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:48.265950 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cc870ff5-e227-4d7b-a359-70d0063e14d1 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0219718c-3b99-4964-b90b-40b21630227c" status: 200 len: 351 microversion: 2.1 time: 0.136429 Aug 26 06:16:48.276395 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 19/42] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:48 2022] GET /compute/v2.1/os-volumes/0219718c-3b99-4964-b90b-40b21630227c => generated 351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:16:48.399795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f6fef179-3711-43e3-b752-adc7114a3af6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:48.413525 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f6fef179-3711-43e3-b752-adc7114a3af6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1241 microversion: 2.1 time: 0.388159 Aug 26 06:16:48.415795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 24/43] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:48 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1241 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:48.903932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-21a113c2-ed48-45ad-b437-d52965236dad tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Action: 'create', calling method: .version_select at 0x7f2f09d56430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1506153996", "metadata": {"Type": "work"}}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-21a113c2-ed48-45ad-b437-d52965236dad tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Request method failure captured: Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 122 Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGVQd7QjQGx7vsLabbvbhnGxeW2kPnpJpjFYVq-dl19oBOByyAWE319ucoztdr88f2-FBeI3IzpmWBSVSSeDxThEIsMQgqdtYA2bfwIKy-9APHZ37LLu8AxwT4oetoRvNGLeBjcuiYvzmqdiR5givAgBsQ7ZW1Otl5X7_8cbaEgWNwM Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:16:48.911917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 37dad0317eb546e2a0a5bad75f72c96f Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1506153996", "metadata": {"Type": "work"}}} Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: Aug 26 06:16:48.920595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1506153996', 'metadata': {'Type': 'work'}}}} Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise error Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi '#$%' Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:16:48.921455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 06:16:48.922755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 06:16:48.923862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 06:16:48.923862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.923862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-21a113c2-ed48-45ad-b437-d52965236dad tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:16:48.923862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-21a113c2-ed48-45ad-b437-d52965236dad tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.238644 Aug 26 06:16:48.934742 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 20/44] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 26 06:16:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 06:16:48.937520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-168a656e-37f0-4f97-b3e4-4306faf4fab7 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Action: 'create', calling method: .version_select at 0x7f2f0943f940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1944833398", "metadata": {"Type": "work"}}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-168a656e-37f0-4f97-b3e4-4306faf4fab7 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Request method failure captured: Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 120 Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGVQd7QjQGx7vsLabbvbhnGxeW2kPnpJpjFYVq-dl19oBOByyAWE319ucoztdr88f2-FBeI3IzpmWBSVSSeDxThEIsMQgqdtYA2bfwIKy-9APHZ37LLu8AxwT4oetoRvNGLeBjcuiYvzmqdiR5givAgBsQ7ZW1Otl5X7_8cbaEgWNwM Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:16:48.954727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 37dad0317eb546e2a0a5bad75f72c96f Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1944833398", "metadata": {"Type": "work"}}} Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: Aug 26 06:16:48.956947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1944833398', 'metadata': {'Type': 'work'}}}} Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise error Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi '0' Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:16:48.957994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 06:16:48.960789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 06:16:48.962659 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 06:16:48.962659 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:16:48.967219 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-168a656e-37f0-4f97-b3e4-4306faf4fab7 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:16:48.976110 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-168a656e-37f0-4f97-b3e4-4306faf4fab7 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.040702 Aug 26 06:16:48.977669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 25/45] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 26 06:16:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 06:16:48.991833 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-dede0f0a-7cfc-4f50-9f83-e31ee1df714b tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Action: 'create', calling method: .version_select at 0x7f2f095054c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1769772135", "metadata": {"Type": "work"}}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-dede0f0a-7cfc-4f50-9f83-e31ee1df714b tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Request method failure captured: Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 119 Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGVQd7QjQGx7vsLabbvbhnGxeW2kPnpJpjFYVq-dl19oBOByyAWE319ucoztdr88f2-FBeI3IzpmWBSVSSeDxThEIsMQgqdtYA2bfwIKy-9APHZ37LLu8AxwT4oetoRvNGLeBjcuiYvzmqdiR5givAgBsQ7ZW1Otl5X7_8cbaEgWNwM Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:16:49.004752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 37dad0317eb546e2a0a5bad75f72c96f Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1769772135", "metadata": {"Type": "work"}}} Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: Aug 26 06:16:49.007218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1769772135', 'metadata': {'Type': 'work'}}}} Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise error Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi '' Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:16:49.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 06:16:49.011396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 06:16:49.013436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 06:16:49.013436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.015924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-dede0f0a-7cfc-4f50-9f83-e31ee1df714b tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:16:49.015924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-dede0f0a-7cfc-4f50-9f83-e31ee1df714b tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031662 Aug 26 06:16:49.015924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 21/46] 10.222.0.40 () {60 vars in 1156 bytes} [Fri Aug 26 06:16:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 06:16:49.037151 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ee8c1694-4f87-4a3f-9b65-c0547a020e2d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:49.037853 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ee8c1694-4f87-4a3f-9b65-c0547a020e2d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:49.048801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8f05ba3d-276a-4881-9f36-44c6802542b3 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Calling method '.version_select at 0x7f2f094868b0>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:49.054096 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee8c1694-4f87-4a3f-9b65-c0547a020e2d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:49.055132 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee8c1694-4f87-4a3f-9b65-c0547a020e2d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:49.055589 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee8c1694-4f87-4a3f-9b65-c0547a020e2d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:49.056311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee8c1694-4f87-4a3f-9b65-c0547a020e2d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:49.056813 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee8c1694-4f87-4a3f-9b65-c0547a020e2d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:49.057253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee8c1694-4f87-4a3f-9b65-c0547a020e2d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:49.191104 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ee8c1694-4f87-4a3f-9b65-c0547a020e2d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:49.214214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ee8c1694-4f87-4a3f-9b65-c0547a020e2d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1273 microversion: 2.1 time: 0.181343 Aug 26 06:16:49.216585 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 26/47] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:49 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:49.223090 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-11d2f644-dcd9-4379-aab6-1b0ea363f3ad tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:49.239862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-11d2f644-dcd9-4379-aab6-1b0ea363f3ad tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:49.254335 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11d2f644-dcd9-4379-aab6-1b0ea363f3ad tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:49.255204 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11d2f644-dcd9-4379-aab6-1b0ea363f3ad tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:49.255757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11d2f644-dcd9-4379-aab6-1b0ea363f3ad tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:49.257760 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11d2f644-dcd9-4379-aab6-1b0ea363f3ad tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:49.258558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11d2f644-dcd9-4379-aab6-1b0ea363f3ad tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:49.259160 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11d2f644-dcd9-4379-aab6-1b0ea363f3ad tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:49.353646 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-11d2f644-dcd9-4379-aab6-1b0ea363f3ad tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:49.394078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-11d2f644-dcd9-4379-aab6-1b0ea363f3ad tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1274 microversion: 2.1 time: 0.174453 Aug 26 06:16:49.395133 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 27/48] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:49 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:49.438127 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fd7e04dd-755e-4b40-9d87-4bf22715428b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:49.439431 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fd7e04dd-755e-4b40-9d87-4bf22715428b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:49.449653 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-8f05ba3d-276a-4881-9f36-44c6802542b3 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] HTTP exception thrown: Volume tempest-invalid-1859315439 could not be found. Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8f05ba3d-276a-4881-9f36-44c6802542b3 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Request method failure captured: Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1859315439 HTTP/1.1 Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGVQd7QjQGx7vsLabbvbhnGxeW2kPnpJpjFYVq-dl19oBOByyAWE319ucoztdr88f2-FBeI3IzpmWBSVSSeDxThEIsMQgqdtYA2bfwIKy-9APHZ37LLu8AxwT4oetoRvNGLeBjcuiYvzmqdiR5givAgBsQ7ZW1Otl5X7_8cbaEgWNwM Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:16:49.464443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 37dad0317eb546e2a0a5bad75f72c96f Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Volume tempest-invalid-1859315439 could not be found. Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'tempest-invalid-1859315439'} Aug 26 06:16:49.465754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1859315439 could not be found. (HTTP 404) (Request-ID: req-bb5ce60f-d670-4a6b-a0cf-ae15a22c7d0c) Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:49.467721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 06:16:49.470456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1859315439 could not be found. Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:16:49.471712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1859315439 could not be found. Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1859315439 could not be found. Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8f05ba3d-276a-4881-9f36-44c6802542b3 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Returning 404 to user: Volume tempest-invalid-1859315439 could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8f05ba3d-276a-4881-9f36-44c6802542b3 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1859315439" status: 404 len: 99 microversion: 2.1 time: 0.410128 Aug 26 06:16:49.474783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 22/49] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 26 06:16:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1859315439 => generated 99 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 26 06:16:49.477989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd7e04dd-755e-4b40-9d87-4bf22715428b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:49.477989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd7e04dd-755e-4b40-9d87-4bf22715428b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:49.477989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd7e04dd-755e-4b40-9d87-4bf22715428b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:49.477989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd7e04dd-755e-4b40-9d87-4bf22715428b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:49.479202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-654e2d67-feb2-476b-aea3-be3eec2ac537 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008655 Aug 26 06:16:49.479202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 23/50] 10.222.0.40 () {58 vars in 1140 bytes} [Fri Aug 26 06:16:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 26 06:16:49.479454 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd7e04dd-755e-4b40-9d87-4bf22715428b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:49.479578 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd7e04dd-755e-4b40-9d87-4bf22715428b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:49.503886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0a4b4d90-6caf-4661-b22e-0d673f9375d0 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022689 Aug 26 06:16:49.504684 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 24/51] 10.222.0.40 () {58 vars in 1137 bytes} [Fri Aug 26 06:16:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 06:16:49.536310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4bc40a82-90f4-453d-a75f-74cefc43373b tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Calling method '.version_select at 0x7f2f09d5cdc0>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:49.589389 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-4bc40a82-90f4-453d-a75f-74cefc43373b tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] HTTP exception thrown: Volume d230f572-17fc-4907-93a8-b5052f21d54d could not be found. Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4bc40a82-90f4-453d-a75f-74cefc43373b tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Request method failure captured: Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: DELETE /compute/v2.1/os-volumes/d230f572-17fc-4907-93a8-b5052f21d54d HTTP/1.1 Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGVQd7QjQGx7vsLabbvbhnGxeW2kPnpJpjFYVq-dl19oBOByyAWE319ucoztdr88f2-FBeI3IzpmWBSVSSeDxThEIsMQgqdtYA2bfwIKy-9APHZ37LLu8AxwT4oetoRvNGLeBjcuiYvzmqdiR5givAgBsQ7ZW1Otl5X7_8cbaEgWNwM Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:16:49.595455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 37dad0317eb546e2a0a5bad75f72c96f Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Volume d230f572-17fc-4907-93a8-b5052f21d54d could not be found. Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'd230f572-17fc-4907-93a8-b5052f21d54d'} Aug 26 06:16:49.596554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d230f572-17fc-4907-93a8-b5052f21d54d could not be found. (HTTP 404) (Request-ID: req-d2ae750d-e6c2-436f-8eb7-68b373cd8058) Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:49.597326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 06:16:49.598584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d230f572-17fc-4907-93a8-b5052f21d54d could not be found. Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 06:16:49.599649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d230f572-17fc-4907-93a8-b5052f21d54d could not be found. Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d230f572-17fc-4907-93a8-b5052f21d54d could not be found. Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4bc40a82-90f4-453d-a75f-74cefc43373b tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Returning 404 to user: Volume d230f572-17fc-4907-93a8-b5052f21d54d could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4bc40a82-90f4-453d-a75f-74cefc43373b tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/d230f572-17fc-4907-93a8-b5052f21d54d" status: 404 len: 109 microversion: 2.1 time: 0.072369 Aug 26 06:16:49.601285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 25/52] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 06:16:49 2022] DELETE /compute/v2.1/os-volumes/d230f572-17fc-4907-93a8-b5052f21d54d => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:16:49.604202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e65e8512-9bca-4f97-80dd-fba9d9d684a5 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Calling method '.version_select at 0x7f2f09486b80>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:49.666610 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fd7e04dd-755e-4b40-9d87-4bf22715428b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:49.680426 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fd7e04dd-755e-4b40-9d87-4bf22715428b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1289 microversion: 2.1 time: 0.246799 Aug 26 06:16:49.682202 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 28/53] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:49 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1289 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:16:49.686807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-e65e8512-9bca-4f97-80dd-fba9d9d684a5 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] HTTP exception thrown: Volume e58bc58e-cfaf-4a05-b0b7-4bc26c858f20 could not be found. Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e65e8512-9bca-4f97-80dd-fba9d9d684a5 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Request method failure captured: Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/os-volumes/e58bc58e-cfaf-4a05-b0b7-4bc26c858f20 HTTP/1.1 Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGVQd7QjQGx7vsLabbvbhnGxeW2kPnpJpjFYVq-dl19oBOByyAWE319ucoztdr88f2-FBeI3IzpmWBSVSSeDxThEIsMQgqdtYA2bfwIKy-9APHZ37LLu8AxwT4oetoRvNGLeBjcuiYvzmqdiR5givAgBsQ7ZW1Otl5X7_8cbaEgWNwM Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:16:49.688792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ae01bb200e649d0b23f41d09ab1b769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: 1ae01bb200e649d0b23f41d09ab1b769 Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-VolumesNegativeTest-748673878 Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 37dad0317eb546e2a0a5bad75f72c96f Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-VolumesNegativeTest-748673878-project Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Volume e58bc58e-cfaf-4a05-b0b7-4bc26c858f20 could not be found. Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'e58bc58e-cfaf-4a05-b0b7-4bc26c858f20'} Aug 26 06:16:49.689893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e58bc58e-cfaf-4a05-b0b7-4bc26c858f20 could not be found. (HTTP 404) (Request-ID: req-47b5d7e3-272d-4bbe-846d-d69750835f6a) Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:49.690520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 06:16:49.691475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e58bc58e-cfaf-4a05-b0b7-4bc26c858f20 could not be found. Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 06:16:49.692351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e58bc58e-cfaf-4a05-b0b7-4bc26c858f20 could not be found. Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e58bc58e-cfaf-4a05-b0b7-4bc26c858f20 could not be found. Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e65e8512-9bca-4f97-80dd-fba9d9d684a5 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] Returning 404 to user: Volume e58bc58e-cfaf-4a05-b0b7-4bc26c858f20 could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:16:49.693234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e65e8512-9bca-4f97-80dd-fba9d9d684a5 tempest-VolumesNegativeTest-748673878 tempest-VolumesNegativeTest-748673878-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e58bc58e-cfaf-4a05-b0b7-4bc26c858f20" status: 404 len: 109 microversion: 2.1 time: 0.091014 Aug 26 06:16:49.699675 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 26/54] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:49 2022] GET /compute/v2.1/os-volumes/e58bc58e-cfaf-4a05-b0b7-4bc26c858f20 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:16:50.252316 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-32628d54-3b6d-4fd6-8e32-7473c68d4150 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:50.254210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-32628d54-3b6d-4fd6-8e32-7473c68d4150 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:50.269137 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-32628d54-3b6d-4fd6-8e32-7473c68d4150 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:50.270848 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-32628d54-3b6d-4fd6-8e32-7473c68d4150 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:50.271738 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-32628d54-3b6d-4fd6-8e32-7473c68d4150 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:50.275037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-32628d54-3b6d-4fd6-8e32-7473c68d4150 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:50.275843 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-32628d54-3b6d-4fd6-8e32-7473c68d4150 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:50.276521 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-32628d54-3b6d-4fd6-8e32-7473c68d4150 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:50.398275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-32628d54-3b6d-4fd6-8e32-7473c68d4150 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:50.414933 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-32628d54-3b6d-4fd6-8e32-7473c68d4150 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1273 microversion: 2.1 time: 0.177663 Aug 26 06:16:50.418587 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 29/55] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:50 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:50.432327 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-79b496fb-3379-4636-bf4c-16f76d77d0d8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:50.434461 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-79b496fb-3379-4636-bf4c-16f76d77d0d8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:50.447572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-79b496fb-3379-4636-bf4c-16f76d77d0d8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:50.448227 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-79b496fb-3379-4636-bf4c-16f76d77d0d8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:50.448683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-79b496fb-3379-4636-bf4c-16f76d77d0d8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:50.449446 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-79b496fb-3379-4636-bf4c-16f76d77d0d8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:50.449914 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-79b496fb-3379-4636-bf4c-16f76d77d0d8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:50.450348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-79b496fb-3379-4636-bf4c-16f76d77d0d8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:50.658077 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-79b496fb-3379-4636-bf4c-16f76d77d0d8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:50.716478 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-44ac5449-27a1-4f50-9dc8-ea8e647290d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:50.717607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-44ac5449-27a1-4f50-9dc8-ea8e647290d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:50.717756 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-79b496fb-3379-4636-bf4c-16f76d77d0d8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1292 microversion: 2.1 time: 0.302860 Aug 26 06:16:50.733180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 27/56] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:50 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1292 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:50.749566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44ac5449-27a1-4f50-9dc8-ea8e647290d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:50.750500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44ac5449-27a1-4f50-9dc8-ea8e647290d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:50.752687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44ac5449-27a1-4f50-9dc8-ea8e647290d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:50.754459 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44ac5449-27a1-4f50-9dc8-ea8e647290d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:50.758159 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44ac5449-27a1-4f50-9dc8-ea8e647290d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:50.758632 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44ac5449-27a1-4f50-9dc8-ea8e647290d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:50.838935 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-44ac5449-27a1-4f50-9dc8-ea8e647290d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:50.847866 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-44ac5449-27a1-4f50-9dc8-ea8e647290d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1297 microversion: 2.1 time: 0.150261 Aug 26 06:16:50.849236 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 30/57] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:50 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1297 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:51.442669 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d7661212-9cff-4af5-839d-dbda5255f3cc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:51.443482 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d7661212-9cff-4af5-839d-dbda5255f3cc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:51.486065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7661212-9cff-4af5-839d-dbda5255f3cc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:51.493941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7661212-9cff-4af5-839d-dbda5255f3cc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:51.493941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7661212-9cff-4af5-839d-dbda5255f3cc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:51.494646 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7661212-9cff-4af5-839d-dbda5255f3cc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:51.500078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7661212-9cff-4af5-839d-dbda5255f3cc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:51.503080 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7661212-9cff-4af5-839d-dbda5255f3cc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:51.744393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-67cb2539-4ed6-4879-8907-54d1ff68c4bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:51.745154 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-67cb2539-4ed6-4879-8907-54d1ff68c4bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:51.754465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67cb2539-4ed6-4879-8907-54d1ff68c4bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:51.755022 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67cb2539-4ed6-4879-8907-54d1ff68c4bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:51.755484 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67cb2539-4ed6-4879-8907-54d1ff68c4bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:51.759714 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67cb2539-4ed6-4879-8907-54d1ff68c4bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:51.768905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67cb2539-4ed6-4879-8907-54d1ff68c4bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:51.768905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67cb2539-4ed6-4879-8907-54d1ff68c4bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:51.994387 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-67cb2539-4ed6-4879-8907-54d1ff68c4bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:52.004330 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-67cb2539-4ed6-4879-8907-54d1ff68c4bb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1280 microversion: 2.1 time: 0.266243 Aug 26 06:16:52.006833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 31/58] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:51 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1280 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:16:52.022385 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d232faee-965b-4408-aa6d-cd6b57c78fe9 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] Calling method '.version_select at 0x7f2f09511af0>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:52.124259 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d232faee-965b-4408-aa6d-cd6b57c78fe9 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/6f172a88-f069-44ff-8b7a-a2012a8864da" status: 200 len: 350 microversion: 2.1 time: 0.115874 Aug 26 06:16:52.144985 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 32/59] 10.222.0.40 () {58 vars in 1245 bytes} [Fri Aug 26 06:16:52 2022] GET /compute/v2.1/os-volumes/6f172a88-f069-44ff-8b7a-a2012a8864da => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:52.168019 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fddaca32-b1c7-4cf9-b3c0-095de039a72a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:52.170965 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fddaca32-b1c7-4cf9-b3c0-095de039a72a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:52.188267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fddaca32-b1c7-4cf9-b3c0-095de039a72a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:52.189679 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fddaca32-b1c7-4cf9-b3c0-095de039a72a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:52.190735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fddaca32-b1c7-4cf9-b3c0-095de039a72a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:52.192261 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fddaca32-b1c7-4cf9-b3c0-095de039a72a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:52.193311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fddaca32-b1c7-4cf9-b3c0-095de039a72a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:52.194861 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fddaca32-b1c7-4cf9-b3c0-095de039a72a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:52.499290 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d7661212-9cff-4af5-839d-dbda5255f3cc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:52.510854 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d7661212-9cff-4af5-839d-dbda5255f3cc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 1.072524 Aug 26 06:16:52.518308 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fddaca32-b1c7-4cf9-b3c0-095de039a72a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:52.526248 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 28/60] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:51 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:16:52.537297 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fddaca32-b1c7-4cf9-b3c0-095de039a72a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1295 microversion: 2.1 time: 0.390442 Aug 26 06:16:52.538648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 33/61] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:52 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1295 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:52.551074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-575fbd0d-784b-4176-b37f-0d79c9bfce97 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] Calling method '.version_select at 0x7f2f0947d790>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:52.780488 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-575fbd0d-784b-4176-b37f-0d79c9bfce97 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.236629 Aug 26 06:16:52.780488 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 29/62] 10.222.0.40 () {58 vars in 1134 bytes} [Fri Aug 26 06:16:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:52.786105 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9bf532a7-73f3-4e71-968c-fa8e43fb6280 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] Calling method '.version_select at 0x7f2f09511310>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:53.257407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9bf532a7-73f3-4e71-968c-fa8e43fb6280 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.142659 Aug 26 06:16:53.257407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 34/63] 10.222.0.40 () {58 vars in 1149 bytes} [Fri Aug 26 06:16:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:16:53.260341 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e1880324-2079-410f-9647-496eeab60bdb tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] Calling method '.version_select at 0x7f2f09411dc0>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:53.260765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-aebdbd11-6ac3-4b6e-867b-d6f9301a60bd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:53.260765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-aebdbd11-6ac3-4b6e-867b-d6f9301a60bd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:53.260765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aebdbd11-6ac3-4b6e-867b-d6f9301a60bd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:53.260765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aebdbd11-6ac3-4b6e-867b-d6f9301a60bd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:53.261101 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aebdbd11-6ac3-4b6e-867b-d6f9301a60bd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:53.261101 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aebdbd11-6ac3-4b6e-867b-d6f9301a60bd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:53.261101 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aebdbd11-6ac3-4b6e-867b-d6f9301a60bd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:53.261101 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aebdbd11-6ac3-4b6e-867b-d6f9301a60bd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:53.261514 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e1880324-2079-410f-9647-496eeab60bdb tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.171285 Aug 26 06:16:53.261514 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 30/64] 10.222.0.40 () {58 vars in 1134 bytes} [Fri Aug 26 06:16:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:53.261950 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-aebdbd11-6ac3-4b6e-867b-d6f9301a60bd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:53.261950 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-aebdbd11-6ac3-4b6e-867b-d6f9301a60bd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.219612 Aug 26 06:16:53.261950 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 35/65] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:53 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:16:53.285767 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-97d5c1e6-f489-4e96-ab60-5c35951d0537 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] Calling method '.version_select at 0x7f2f09410700>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:53.442525 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-97d5c1e6-f489-4e96-ab60-5c35951d0537 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.161534 Aug 26 06:16:53.443426 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 31/66] 10.222.0.40 () {58 vars in 1167 bytes} [Fri Aug 26 06:16:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:53.465432 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dfdbce16-31cc-47ac-9beb-a1b8787f4f24 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] Calling method '.version_select at 0x7f2f0948df70>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:53.563498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-002ccdb7-a2aa-428e-b3e5-756345ba2584 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:53.563498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-002ccdb7-a2aa-428e-b3e5-756345ba2584 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:53.578795 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-002ccdb7-a2aa-428e-b3e5-756345ba2584 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:53.579613 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-002ccdb7-a2aa-428e-b3e5-756345ba2584 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:53.580249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-002ccdb7-a2aa-428e-b3e5-756345ba2584 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:53.581555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-002ccdb7-a2aa-428e-b3e5-756345ba2584 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:53.582476 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-002ccdb7-a2aa-428e-b3e5-756345ba2584 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:53.587644 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-002ccdb7-a2aa-428e-b3e5-756345ba2584 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:53.725963 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-dfdbce16-31cc-47ac-9beb-a1b8787f4f24 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.268539 Aug 26 06:16:53.726646 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 36/67] 10.222.0.40 () {58 vars in 1170 bytes} [Fri Aug 26 06:16:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:53.733286 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1e1b2e6c-5958-417d-ae24-b5f040184808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:53.752958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1e1b2e6c-5958-417d-ae24-b5f040184808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:53.752958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e1b2e6c-5958-417d-ae24-b5f040184808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:53.752958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e1b2e6c-5958-417d-ae24-b5f040184808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:53.752958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e1b2e6c-5958-417d-ae24-b5f040184808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:53.754133 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e1b2e6c-5958-417d-ae24-b5f040184808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:53.754133 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e1b2e6c-5958-417d-ae24-b5f040184808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:53.754133 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e1b2e6c-5958-417d-ae24-b5f040184808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:54.888645 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-002ccdb7-a2aa-428e-b3e5-756345ba2584 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:54.901283 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-002ccdb7-a2aa-428e-b3e5-756345ba2584 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 1.351562 Aug 26 06:16:54.904083 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=4 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:54.905224 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 32/68] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:53 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:54.917196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-30d59acb-7f75-4271-8b43-3770f0b0d6cb tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] Calling method '.version_select at 0x7f2f0944f820>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:55.077839 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=4 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:55.121554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-30d59acb-7f75-4271-8b43-3770f0b0d6cb tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.216408 Aug 26 06:16:55.122749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 33/69] 10.222.0.40 () {58 vars in 1155 bytes} [Fri Aug 26 06:16:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:55.128976 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b13ac19b-3729-48ba-9728-3f95da95a345 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:55.131786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b13ac19b-3729-48ba-9728-3f95da95a345 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:55.132718 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1e1b2e6c-5958-417d-ae24-b5f040184808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:55.149791 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1e1b2e6c-5958-417d-ae24-b5f040184808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 1.421253 Aug 26 06:16:55.151520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b13ac19b-3729-48ba-9728-3f95da95a345 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:55.152333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 37/70] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:53 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:55.155115 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b13ac19b-3729-48ba-9728-3f95da95a345 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:55.157881 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b13ac19b-3729-48ba-9728-3f95da95a345 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:55.158977 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b13ac19b-3729-48ba-9728-3f95da95a345 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:55.159691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b13ac19b-3729-48ba-9728-3f95da95a345 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:55.160350 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b13ac19b-3729-48ba-9728-3f95da95a345 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:55.169399 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-61b4f082-9347-4c1f-9f27-248e418596fa tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] Calling method '.version_select at 0x7f2f09511550>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:55.559789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-61b4f082-9347-4c1f-9f27-248e418596fa tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.404042 Aug 26 06:16:55.560529 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 38/71] 10.222.0.40 () {58 vars in 1188 bytes} [Fri Aug 26 06:16:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:55.574277 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-261ff49d-4dc3-45c4-84a3-dc95c370ca42 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] Calling method '.version_select at 0x7f2f094569d0>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:55.923957 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-261ff49d-4dc3-45c4-84a3-dc95c370ca42 tempest-VolumesTestJSON-1446879465 tempest-VolumesTestJSON-1446879465-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.353727 Aug 26 06:16:55.934812 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 39/72] 10.222.0.40 () {58 vars in 1155 bytes} [Fri Aug 26 06:16:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:55.945892 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-13336a62-0ae3-4d7d-bc6e-0d2688361e9d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:55.947045 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-13336a62-0ae3-4d7d-bc6e-0d2688361e9d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:55.957436 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-13336a62-0ae3-4d7d-bc6e-0d2688361e9d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:55.960733 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-13336a62-0ae3-4d7d-bc6e-0d2688361e9d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:55.965986 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-13336a62-0ae3-4d7d-bc6e-0d2688361e9d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:55.965986 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-13336a62-0ae3-4d7d-bc6e-0d2688361e9d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:55.965986 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-13336a62-0ae3-4d7d-bc6e-0d2688361e9d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:55.965986 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-13336a62-0ae3-4d7d-bc6e-0d2688361e9d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:56.236010 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b13ac19b-3729-48ba-9728-3f95da95a345 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:56.280998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b13ac19b-3729-48ba-9728-3f95da95a345 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 1.152865 Aug 26 06:16:56.285251 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 34/73] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:55 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:56.526014 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-485c8b5f-8974-4b99-a684-db1e3e7d4096 req-281ff3cc-6a01-44e7-8620-f555a93aeb93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "012ac1bd-a390-4776-841b-f11f736a3d9f", "tag": "e7a88b0e-f6e1-473e-9018-7ee3f4181af9"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:56.578487 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-485c8b5f-8974-4b99-a684-db1e3e7d4096 req-281ff3cc-6a01-44e7-8620-f555a93aeb93 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:56.579392 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-485c8b5f-8974-4b99-a684-db1e3e7d4096 req-281ff3cc-6a01-44e7-8620-f555a93aeb93 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:56.580168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-485c8b5f-8974-4b99-a684-db1e3e7d4096 req-281ff3cc-6a01-44e7-8620-f555a93aeb93 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:56.630378 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-485c8b5f-8974-4b99-a684-db1e3e7d4096 req-281ff3cc-6a01-44e7-8620-f555a93aeb93 service nova] Creating event network-changed:e7a88b0e-f6e1-473e-9018-7ee3f4181af9 for instance 012ac1bd-a390-4776-841b-f11f736a3d9f on hv-cinder-85391 Aug 26 06:16:56.632459 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-485c8b5f-8974-4b99-a684-db1e3e7d4096 req-281ff3cc-6a01-44e7-8620-f555a93aeb93 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 06:16:56.632920 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-485c8b5f-8974-4b99-a684-db1e3e7d4096 req-281ff3cc-6a01-44e7-8620-f555a93aeb93 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 06:16:56.634376 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4825bbd8-489e-4a3e-80bf-9b6ef089872a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:56.635150 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4825bbd8-489e-4a3e-80bf-9b6ef089872a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:56.636317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4825bbd8-489e-4a3e-80bf-9b6ef089872a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:56.637945 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4825bbd8-489e-4a3e-80bf-9b6ef089872a None None] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:56.638831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4825bbd8-489e-4a3e-80bf-9b6ef089872a None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:56.639928 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4825bbd8-489e-4a3e-80bf-9b6ef089872a None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:56.685806 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.compute.rpcapi [None req-4825bbd8-489e-4a3e-80bf-9b6ef089872a None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 06:16:56.692698 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4825bbd8-489e-4a3e-80bf-9b6ef089872a None None] Releasing lock "compute-rpcapi-router" {{(pid=121343) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 06:16:56.739013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4825bbd8-489e-4a3e-80bf-9b6ef089872a None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.450109 Aug 26 06:16:56.740260 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 35/74] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:56.748267 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f612ba4e-6b30-4ce1-b95c-794b6f9f03b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:56.750146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f612ba4e-6b30-4ce1-b95c-794b6f9f03b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:56.761381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f612ba4e-6b30-4ce1-b95c-794b6f9f03b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:56.762125 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f612ba4e-6b30-4ce1-b95c-794b6f9f03b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:56.762791 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f612ba4e-6b30-4ce1-b95c-794b6f9f03b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:56.773691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f612ba4e-6b30-4ce1-b95c-794b6f9f03b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:56.773691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f612ba4e-6b30-4ce1-b95c-794b6f9f03b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:56.778241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f612ba4e-6b30-4ce1-b95c-794b6f9f03b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:56.835566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=22 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:56.893016 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=20 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:16:57.071659 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-13336a62-0ae3-4d7d-bc6e-0d2688361e9d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:57.082372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-13336a62-0ae3-4d7d-bc6e-0d2688361e9d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 1.146197 Aug 26 06:16:57.083000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 40/75] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:55 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:57.513519 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-cb022c82-fc15-4beb-850b-55d467c35158 req-686aef29-4ea7-4c5c-8f2c-f6a93c3f7a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3647fa12-4de4-4b81-aca1-4687ec0af8f9", "tag": "25e49a9c-7d0c-440b-b98b-c8b9503ba03f"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:57.543696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-cb022c82-fc15-4beb-850b-55d467c35158 req-686aef29-4ea7-4c5c-8f2c-f6a93c3f7a1e service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:57.547625 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-cb022c82-fc15-4beb-850b-55d467c35158 req-686aef29-4ea7-4c5c-8f2c-f6a93c3f7a1e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:57.553947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-cb022c82-fc15-4beb-850b-55d467c35158 req-686aef29-4ea7-4c5c-8f2c-f6a93c3f7a1e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:57.620310 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-cb022c82-fc15-4beb-850b-55d467c35158 req-686aef29-4ea7-4c5c-8f2c-f6a93c3f7a1e service nova] Creating event network-changed:25e49a9c-7d0c-440b-b98b-c8b9503ba03f for instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 on hv-cinder-85391 Aug 26 06:16:57.625390 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-cb022c82-fc15-4beb-850b-55d467c35158 req-686aef29-4ea7-4c5c-8f2c-f6a93c3f7a1e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121344) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 06:16:57.631013 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-cb022c82-fc15-4beb-850b-55d467c35158 req-686aef29-4ea7-4c5c-8f2c-f6a93c3f7a1e service nova] Acquired lock "compute-rpcapi-router" {{(pid=121344) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 06:16:57.631013 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc7804ee-5a16-4d0f-bfd2-3c7d4e9ac21f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:57.631013 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc7804ee-5a16-4d0f-bfd2-3c7d4e9ac21f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:57.632181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc7804ee-5a16-4d0f-bfd2-3c7d4e9ac21f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:57.633920 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc7804ee-5a16-4d0f-bfd2-3c7d4e9ac21f None None] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:57.634706 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc7804ee-5a16-4d0f-bfd2-3c7d4e9ac21f None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:57.635365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc7804ee-5a16-4d0f-bfd2-3c7d4e9ac21f None None] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:57.648359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.compute.rpcapi [None req-fc7804ee-5a16-4d0f-bfd2-3c7d4e9ac21f None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 06:16:57.649590 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc7804ee-5a16-4d0f-bfd2-3c7d4e9ac21f None None] Releasing lock "compute-rpcapi-router" {{(pid=121344) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 06:16:57.671269 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fc7804ee-5a16-4d0f-bfd2-3c7d4e9ac21f None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.586526 Aug 26 06:16:57.677075 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 41/76] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:16:57.683911 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ce4c8d9a-ac4d-4c86-88f5-b26a197b66a8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:57.687075 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ce4c8d9a-ac4d-4c86-88f5-b26a197b66a8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:57.706595 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce4c8d9a-ac4d-4c86-88f5-b26a197b66a8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:57.711311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce4c8d9a-ac4d-4c86-88f5-b26a197b66a8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:57.712219 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce4c8d9a-ac4d-4c86-88f5-b26a197b66a8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:57.714905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce4c8d9a-ac4d-4c86-88f5-b26a197b66a8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:57.716349 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce4c8d9a-ac4d-4c86-88f5-b26a197b66a8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:57.717379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce4c8d9a-ac4d-4c86-88f5-b26a197b66a8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:57.853862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f612ba4e-6b30-4ce1-b95c-794b6f9f03b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:57.873120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f612ba4e-6b30-4ce1-b95c-794b6f9f03b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 1.130361 Aug 26 06:16:57.875608 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 36/77] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:56 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:57.954522 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ce4c8d9a-ac4d-4c86-88f5-b26a197b66a8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:58.000758 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ce4c8d9a-ac4d-4c86-88f5-b26a197b66a8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.325969 Aug 26 06:16:58.002206 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 42/78] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:57 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:58.106399 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ce89d2c3-06d8-49c7-a492-a3a0ec23925a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:58.107045 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ce89d2c3-06d8-49c7-a492-a3a0ec23925a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:58.133574 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce89d2c3-06d8-49c7-a492-a3a0ec23925a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:58.134766 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce89d2c3-06d8-49c7-a492-a3a0ec23925a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:58.135586 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce89d2c3-06d8-49c7-a492-a3a0ec23925a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:58.137514 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce89d2c3-06d8-49c7-a492-a3a0ec23925a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:58.140395 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce89d2c3-06d8-49c7-a492-a3a0ec23925a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:58.141153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce89d2c3-06d8-49c7-a492-a3a0ec23925a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:58.896477 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-cb6c516e-ec67-487c-b80d-668c91eaa6fa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:58.899429 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-cb6c516e-ec67-487c-b80d-668c91eaa6fa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:58.910028 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cb6c516e-ec67-487c-b80d-668c91eaa6fa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:58.914248 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cb6c516e-ec67-487c-b80d-668c91eaa6fa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:58.914248 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cb6c516e-ec67-487c-b80d-668c91eaa6fa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:58.914248 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cb6c516e-ec67-487c-b80d-668c91eaa6fa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:58.914248 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cb6c516e-ec67-487c-b80d-668c91eaa6fa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:58.915571 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cb6c516e-ec67-487c-b80d-668c91eaa6fa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:59.007042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ce89d2c3-06d8-49c7-a492-a3a0ec23925a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:59.024241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ce89d2c3-06d8-49c7-a492-a3a0ec23925a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.921913 Aug 26 06:16:59.025871 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 37/79] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:58 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:59.037310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f8d4581f-fde8-451d-9490-9d9ce87f9ceb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:16:59.038767 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f8d4581f-fde8-451d-9490-9d9ce87f9ceb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:16:59.062942 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8d4581f-fde8-451d-9490-9d9ce87f9ceb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:59.066782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8d4581f-fde8-451d-9490-9d9ce87f9ceb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:59.067688 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8d4581f-fde8-451d-9490-9d9ce87f9ceb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:59.070443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8d4581f-fde8-451d-9490-9d9ce87f9ceb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:59.071272 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8d4581f-fde8-451d-9490-9d9ce87f9ceb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:59.074556 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8d4581f-fde8-451d-9490-9d9ce87f9ceb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:59.615049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f8d4581f-fde8-451d-9490-9d9ce87f9ceb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:59.691444 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f8d4581f-fde8-451d-9490-9d9ce87f9ceb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.656170 Aug 26 06:16:59.692107 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 38/80] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:59 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:16:59.746409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-cb6c516e-ec67-487c-b80d-668c91eaa6fa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:16:59.761015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-cb6c516e-ec67-487c-b80d-668c91eaa6fa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.868520 Aug 26 06:16:59.762271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 43/81] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:16:58 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:16:59.796927 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-07557e62-b0be-4ec2-af80-48cdcd37af9f req-d7df0d44-90b1-440b-ab12-2311eb7c71ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea7e392a-1a02-4faa-a63e-5ac717bd2537", "tag": "40c6359b-4d02-4846-9ca2-697e2425c559"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:16:59.885188 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-07557e62-b0be-4ec2-af80-48cdcd37af9f req-d7df0d44-90b1-440b-ab12-2311eb7c71ff service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:16:59.894202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-07557e62-b0be-4ec2-af80-48cdcd37af9f req-d7df0d44-90b1-440b-ab12-2311eb7c71ff service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:16:59.895248 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-07557e62-b0be-4ec2-af80-48cdcd37af9f req-d7df0d44-90b1-440b-ab12-2311eb7c71ff service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:16:59.973630 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-07557e62-b0be-4ec2-af80-48cdcd37af9f req-d7df0d44-90b1-440b-ab12-2311eb7c71ff service nova] Creating event network-changed:40c6359b-4d02-4846-9ca2-697e2425c559 for instance ea7e392a-1a02-4faa-a63e-5ac717bd2537 on hv-cinder-85391 Aug 26 06:17:00.025119 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-07557e62-b0be-4ec2-af80-48cdcd37af9f req-d7df0d44-90b1-440b-ab12-2311eb7c71ff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237110 Aug 26 06:17:00.029932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 39/82] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:17:00.053560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-74248b1b-d7ca-41fd-bbf8-9b81116da037 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:00.055489 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-74248b1b-d7ca-41fd-bbf8-9b81116da037 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:00.077031 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-74248b1b-d7ca-41fd-bbf8-9b81116da037 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:00.077031 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-74248b1b-d7ca-41fd-bbf8-9b81116da037 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:00.077031 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-74248b1b-d7ca-41fd-bbf8-9b81116da037 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:00.077031 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-74248b1b-d7ca-41fd-bbf8-9b81116da037 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:00.077442 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-74248b1b-d7ca-41fd-bbf8-9b81116da037 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:00.077442 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-74248b1b-d7ca-41fd-bbf8-9b81116da037 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:00.613331 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-74248b1b-d7ca-41fd-bbf8-9b81116da037 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:00.643193 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-74248b1b-d7ca-41fd-bbf8-9b81116da037 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.594868 Aug 26 06:17:00.661846 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 44/83] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:00 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:00.720675 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0a09a123-be40-458e-8f3b-bb0886fc4016 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:00.722639 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0a09a123-be40-458e-8f3b-bb0886fc4016 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:00.738328 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a09a123-be40-458e-8f3b-bb0886fc4016 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:00.739179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a09a123-be40-458e-8f3b-bb0886fc4016 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:00.743346 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a09a123-be40-458e-8f3b-bb0886fc4016 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:00.744356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a09a123-be40-458e-8f3b-bb0886fc4016 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:00.745007 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a09a123-be40-458e-8f3b-bb0886fc4016 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:00.746320 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a09a123-be40-458e-8f3b-bb0886fc4016 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:00.789580 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a042f7bf-eeee-444f-bec1-1145720b9228 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:00.790559 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a042f7bf-eeee-444f-bec1-1145720b9228 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:00.814524 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a042f7bf-eeee-444f-bec1-1145720b9228 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:00.815312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a042f7bf-eeee-444f-bec1-1145720b9228 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:00.816315 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a042f7bf-eeee-444f-bec1-1145720b9228 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:00.818147 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a042f7bf-eeee-444f-bec1-1145720b9228 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:00.820493 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a042f7bf-eeee-444f-bec1-1145720b9228 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:00.821002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a042f7bf-eeee-444f-bec1-1145720b9228 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:00.830972 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:01.278733 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a042f7bf-eeee-444f-bec1-1145720b9228 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:01.297537 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a042f7bf-eeee-444f-bec1-1145720b9228 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.505712 Aug 26 06:17:01.302460 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 45/84] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:00 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:01.695523 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-188ab76f-3518-4917-bb46-cf0579273d48 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:01.696857 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-188ab76f-3518-4917-bb46-cf0579273d48 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:01.706342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-188ab76f-3518-4917-bb46-cf0579273d48 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:01.710243 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-188ab76f-3518-4917-bb46-cf0579273d48 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:01.713424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-188ab76f-3518-4917-bb46-cf0579273d48 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:01.714445 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-188ab76f-3518-4917-bb46-cf0579273d48 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:01.716522 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-188ab76f-3518-4917-bb46-cf0579273d48 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:01.722995 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-188ab76f-3518-4917-bb46-cf0579273d48 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:01.751412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0a09a123-be40-458e-8f3b-bb0886fc4016 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:01.770263 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0a09a123-be40-458e-8f3b-bb0886fc4016 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 1.050246 Aug 26 06:17:01.773201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 40/85] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:00 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:02.004738 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-188ab76f-3518-4917-bb46-cf0579273d48 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:02.019584 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-188ab76f-3518-4917-bb46-cf0579273d48 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.332764 Aug 26 06:17:02.033643 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 46/86] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:01 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:02.101879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-e697a8a5-edf7-453c-abed-51363c629d25 req-553e51d4-1f00-44f4-8576-65df4b8992ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0dda9da-e7bd-4a7d-b807-a2074ccbe208", "tag": "eb6ebb39-9a85-4eaa-88a1-9d3aff9f8785"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:17:02.120763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e697a8a5-edf7-453c-abed-51363c629d25 req-553e51d4-1f00-44f4-8576-65df4b8992ee service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:02.124763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e697a8a5-edf7-453c-abed-51363c629d25 req-553e51d4-1f00-44f4-8576-65df4b8992ee service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:02.125403 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e697a8a5-edf7-453c-abed-51363c629d25 req-553e51d4-1f00-44f4-8576-65df4b8992ee service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:02.152870 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-e697a8a5-edf7-453c-abed-51363c629d25 req-553e51d4-1f00-44f4-8576-65df4b8992ee service nova] Creating event network-changed:eb6ebb39-9a85-4eaa-88a1-9d3aff9f8785 for instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 on hv-cinder-85391 Aug 26 06:17:02.171127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-e697a8a5-edf7-453c-abed-51363c629d25 req-553e51d4-1f00-44f4-8576-65df4b8992ee service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073383 Aug 26 06:17:02.173693 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 41/87] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:17:02.329961 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-60493e2d-4737-4714-aac2-5b0419355af7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:02.331095 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-60493e2d-4737-4714-aac2-5b0419355af7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:02.341024 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-60493e2d-4737-4714-aac2-5b0419355af7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:02.341604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-60493e2d-4737-4714-aac2-5b0419355af7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:02.342247 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-60493e2d-4737-4714-aac2-5b0419355af7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:02.343199 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-60493e2d-4737-4714-aac2-5b0419355af7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:02.343861 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-60493e2d-4737-4714-aac2-5b0419355af7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:02.344579 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-60493e2d-4737-4714-aac2-5b0419355af7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:02.636028 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-60493e2d-4737-4714-aac2-5b0419355af7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:02.659901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-60493e2d-4737-4714-aac2-5b0419355af7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.334998 Aug 26 06:17:02.661387 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 47/88] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:02 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:02.807224 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c2f5f05c-8883-4b82-96e7-bc1c66f9cac9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:02.808571 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c2f5f05c-8883-4b82-96e7-bc1c66f9cac9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:02.829243 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2f5f05c-8883-4b82-96e7-bc1c66f9cac9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:02.829900 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2f5f05c-8883-4b82-96e7-bc1c66f9cac9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:02.830485 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2f5f05c-8883-4b82-96e7-bc1c66f9cac9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:02.831397 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2f5f05c-8883-4b82-96e7-bc1c66f9cac9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:02.832001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2f5f05c-8883-4b82-96e7-bc1c66f9cac9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:02.832574 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2f5f05c-8883-4b82-96e7-bc1c66f9cac9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:03.041367 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-27fd4d9d-6b11-4cb7-b7ab-c66009af6d0c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:03.042361 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-27fd4d9d-6b11-4cb7-b7ab-c66009af6d0c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:03.053892 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27fd4d9d-6b11-4cb7-b7ab-c66009af6d0c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:03.056406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27fd4d9d-6b11-4cb7-b7ab-c66009af6d0c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:03.056945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27fd4d9d-6b11-4cb7-b7ab-c66009af6d0c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:03.057745 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27fd4d9d-6b11-4cb7-b7ab-c66009af6d0c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:03.058610 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27fd4d9d-6b11-4cb7-b7ab-c66009af6d0c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:03.059123 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27fd4d9d-6b11-4cb7-b7ab-c66009af6d0c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:03.312986 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-27fd4d9d-6b11-4cb7-b7ab-c66009af6d0c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:03.328382 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-27fd4d9d-6b11-4cb7-b7ab-c66009af6d0c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.291162 Aug 26 06:17:03.328979 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 48/89] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:03 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:03.370523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c2f5f05c-8883-4b82-96e7-bc1c66f9cac9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:03.381316 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c2f5f05c-8883-4b82-96e7-bc1c66f9cac9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.579090 Aug 26 06:17:03.382749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 42/90] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:02 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:03.684753 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0438bd6b-f758-4cee-ae59-c81ad853cc3a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:03.685759 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0438bd6b-f758-4cee-ae59-c81ad853cc3a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:03.700212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0438bd6b-f758-4cee-ae59-c81ad853cc3a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:03.701298 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0438bd6b-f758-4cee-ae59-c81ad853cc3a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:03.702404 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0438bd6b-f758-4cee-ae59-c81ad853cc3a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:03.703980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0438bd6b-f758-4cee-ae59-c81ad853cc3a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:03.704820 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0438bd6b-f758-4cee-ae59-c81ad853cc3a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:03.705495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0438bd6b-f758-4cee-ae59-c81ad853cc3a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:04.066571 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0438bd6b-f758-4cee-ae59-c81ad853cc3a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:04.083050 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0438bd6b-f758-4cee-ae59-c81ad853cc3a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.403096 Aug 26 06:17:04.086906 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 49/91] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:03 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:04.359867 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-81316be5-3f51-417b-bf91-4ee2a5ecae39 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:04.361218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-81316be5-3f51-417b-bf91-4ee2a5ecae39 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:04.372012 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-81316be5-3f51-417b-bf91-4ee2a5ecae39 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:04.373088 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-81316be5-3f51-417b-bf91-4ee2a5ecae39 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:04.373823 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-81316be5-3f51-417b-bf91-4ee2a5ecae39 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:04.374836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-81316be5-3f51-417b-bf91-4ee2a5ecae39 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:04.376380 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-81316be5-3f51-417b-bf91-4ee2a5ecae39 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:04.377194 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-81316be5-3f51-417b-bf91-4ee2a5ecae39 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:04.434276 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c375a2f7-7a87-4505-93d4-0edd45940259 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:04.434276 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c375a2f7-7a87-4505-93d4-0edd45940259 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:04.434276 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c375a2f7-7a87-4505-93d4-0edd45940259 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:04.434276 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c375a2f7-7a87-4505-93d4-0edd45940259 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:04.435027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c375a2f7-7a87-4505-93d4-0edd45940259 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:04.435027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c375a2f7-7a87-4505-93d4-0edd45940259 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:04.435027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c375a2f7-7a87-4505-93d4-0edd45940259 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:04.435027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c375a2f7-7a87-4505-93d4-0edd45940259 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:04.681092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-81316be5-3f51-417b-bf91-4ee2a5ecae39 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:04.705793 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-81316be5-3f51-417b-bf91-4ee2a5ecae39 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.354100 Aug 26 06:17:04.707788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 43/92] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:04 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:04.772203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c375a2f7-7a87-4505-93d4-0edd45940259 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:04.781201 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c375a2f7-7a87-4505-93d4-0edd45940259 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.381697 Aug 26 06:17:04.781884 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 50/93] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:04 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:05.113820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5565d2de-2a3f-4181-9258-ac1742111f0f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:05.114432 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5565d2de-2a3f-4181-9258-ac1742111f0f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:05.125325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5565d2de-2a3f-4181-9258-ac1742111f0f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:05.125325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5565d2de-2a3f-4181-9258-ac1742111f0f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:05.125325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5565d2de-2a3f-4181-9258-ac1742111f0f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:05.125325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5565d2de-2a3f-4181-9258-ac1742111f0f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:05.125942 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5565d2de-2a3f-4181-9258-ac1742111f0f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:05.125942 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5565d2de-2a3f-4181-9258-ac1742111f0f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:05.278753 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5565d2de-2a3f-4181-9258-ac1742111f0f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:05.290432 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5565d2de-2a3f-4181-9258-ac1742111f0f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.180504 Aug 26 06:17:05.291456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 44/94] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:05 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:05.737289 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6e00524f-8e6f-4f34-9de9-cdebe948eedb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:05.737901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6e00524f-8e6f-4f34-9de9-cdebe948eedb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:05.740015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:05.751294 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e00524f-8e6f-4f34-9de9-cdebe948eedb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:05.751778 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e00524f-8e6f-4f34-9de9-cdebe948eedb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:05.752208 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e00524f-8e6f-4f34-9de9-cdebe948eedb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:05.752896 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e00524f-8e6f-4f34-9de9-cdebe948eedb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:05.753434 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e00524f-8e6f-4f34-9de9-cdebe948eedb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:05.753964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e00524f-8e6f-4f34-9de9-cdebe948eedb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:05.809369 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f71a4b94-d056-4a0e-9de2-1f5815635e21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:05.810838 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f71a4b94-d056-4a0e-9de2-1f5815635e21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:05.819982 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f71a4b94-d056-4a0e-9de2-1f5815635e21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:05.821237 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f71a4b94-d056-4a0e-9de2-1f5815635e21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:05.822072 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f71a4b94-d056-4a0e-9de2-1f5815635e21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:05.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f71a4b94-d056-4a0e-9de2-1f5815635e21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:05.824141 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f71a4b94-d056-4a0e-9de2-1f5815635e21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:05.825048 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f71a4b94-d056-4a0e-9de2-1f5815635e21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:05.929529 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6e00524f-8e6f-4f34-9de9-cdebe948eedb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:05.938321 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6e00524f-8e6f-4f34-9de9-cdebe948eedb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.205551 Aug 26 06:17:05.938952 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 51/95] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:05 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:05.979605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f71a4b94-d056-4a0e-9de2-1f5815635e21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:05.987329 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f71a4b94-d056-4a0e-9de2-1f5815635e21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.186496 Aug 26 06:17:05.987889 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 45/96] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:05 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:06.311839 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-34244355-1ff9-44b0-9460-6ca24eae58d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:06.312447 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-34244355-1ff9-44b0-9460-6ca24eae58d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:06.320917 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34244355-1ff9-44b0-9460-6ca24eae58d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:06.321391 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34244355-1ff9-44b0-9460-6ca24eae58d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:06.321834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34244355-1ff9-44b0-9460-6ca24eae58d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:06.322539 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34244355-1ff9-44b0-9460-6ca24eae58d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:06.323042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34244355-1ff9-44b0-9460-6ca24eae58d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:06.323471 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34244355-1ff9-44b0-9460-6ca24eae58d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:06.514843 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-34244355-1ff9-44b0-9460-6ca24eae58d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:06.525599 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-34244355-1ff9-44b0-9460-6ca24eae58d2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.217474 Aug 26 06:17:06.526934 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 52/97] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:06 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:06.963118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:06.970153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e88da544-050e-4389-8bb2-9c11e7a825a2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:06.970822 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e88da544-050e-4389-8bb2-9c11e7a825a2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:06.972673 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:06.987287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e88da544-050e-4389-8bb2-9c11e7a825a2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:06.987287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e88da544-050e-4389-8bb2-9c11e7a825a2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:06.987287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e88da544-050e-4389-8bb2-9c11e7a825a2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:06.987287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e88da544-050e-4389-8bb2-9c11e7a825a2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:06.987877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e88da544-050e-4389-8bb2-9c11e7a825a2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:06.987877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e88da544-050e-4389-8bb2-9c11e7a825a2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:07.003252 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=97 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:07.010050 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dcd2a77d-ae69-42fa-82b3-9580160c8cdb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:07.010702 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-dcd2a77d-ae69-42fa-82b3-9580160c8cdb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:07.033289 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcd2a77d-ae69-42fa-82b3-9580160c8cdb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:07.033289 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcd2a77d-ae69-42fa-82b3-9580160c8cdb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:07.033289 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcd2a77d-ae69-42fa-82b3-9580160c8cdb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:07.033675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcd2a77d-ae69-42fa-82b3-9580160c8cdb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:07.034132 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcd2a77d-ae69-42fa-82b3-9580160c8cdb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:07.034560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcd2a77d-ae69-42fa-82b3-9580160c8cdb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:07.312271 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e88da544-050e-4389-8bb2-9c11e7a825a2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:07.328545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-dcd2a77d-ae69-42fa-82b3-9580160c8cdb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:07.338448 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e88da544-050e-4389-8bb2-9c11e7a825a2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.376328 Aug 26 06:17:07.339847 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 46/98] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:06 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:07.340063 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-dcd2a77d-ae69-42fa-82b3-9580160c8cdb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.333577 Aug 26 06:17:07.347363 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 53/99] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:07 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:07.555697 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e5b3444f-e189-4b6f-b23d-9211fd588481 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:07.556635 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e5b3444f-e189-4b6f-b23d-9211fd588481 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:07.574103 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5b3444f-e189-4b6f-b23d-9211fd588481 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:07.574999 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5b3444f-e189-4b6f-b23d-9211fd588481 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:07.575854 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5b3444f-e189-4b6f-b23d-9211fd588481 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:07.576682 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5b3444f-e189-4b6f-b23d-9211fd588481 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:07.577306 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5b3444f-e189-4b6f-b23d-9211fd588481 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:07.577744 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5b3444f-e189-4b6f-b23d-9211fd588481 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:07.746522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e5b3444f-e189-4b6f-b23d-9211fd588481 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:07.763134 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e5b3444f-e189-4b6f-b23d-9211fd588481 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.217611 Aug 26 06:17:07.764300 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 47/100] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:07 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:08.370389 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8d2a6326-1399-4486-b6d0-0a0a857dad06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:08.371554 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8d2a6326-1399-4486-b6d0-0a0a857dad06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:08.376542 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f848642a-6243-4148-a080-aa85cbb2e66d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:08.380370 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f848642a-6243-4148-a080-aa85cbb2e66d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:08.386081 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:08.388653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d2a6326-1399-4486-b6d0-0a0a857dad06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:08.389650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d2a6326-1399-4486-b6d0-0a0a857dad06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:08.392881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d2a6326-1399-4486-b6d0-0a0a857dad06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:08.392881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d2a6326-1399-4486-b6d0-0a0a857dad06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:08.392881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d2a6326-1399-4486-b6d0-0a0a857dad06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:08.393645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d2a6326-1399-4486-b6d0-0a0a857dad06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:08.409420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f848642a-6243-4148-a080-aa85cbb2e66d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:08.409910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f848642a-6243-4148-a080-aa85cbb2e66d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:08.410347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f848642a-6243-4148-a080-aa85cbb2e66d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:08.414325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f848642a-6243-4148-a080-aa85cbb2e66d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:08.414845 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f848642a-6243-4148-a080-aa85cbb2e66d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:08.415284 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f848642a-6243-4148-a080-aa85cbb2e66d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:08.625737 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8d2a6326-1399-4486-b6d0-0a0a857dad06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:08.625912 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f848642a-6243-4148-a080-aa85cbb2e66d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:08.634903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f848642a-6243-4148-a080-aa85cbb2e66d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.266671 Aug 26 06:17:08.635796 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 48/101] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:08 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:08.638950 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8d2a6326-1399-4486-b6d0-0a0a857dad06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.277852 Aug 26 06:17:08.639590 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 54/102] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:08 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:08.793504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cd9f9591-59be-4c8a-8986-1bb927a38699 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:08.793504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-cd9f9591-59be-4c8a-8986-1bb927a38699 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:08.800268 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd9f9591-59be-4c8a-8986-1bb927a38699 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:08.800666 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd9f9591-59be-4c8a-8986-1bb927a38699 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:08.801203 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd9f9591-59be-4c8a-8986-1bb927a38699 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:08.801915 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd9f9591-59be-4c8a-8986-1bb927a38699 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:08.802396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd9f9591-59be-4c8a-8986-1bb927a38699 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:08.802853 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd9f9591-59be-4c8a-8986-1bb927a38699 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:09.043674 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cd9f9591-59be-4c8a-8986-1bb927a38699 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:09.073836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cd9f9591-59be-4c8a-8986-1bb927a38699 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.286214 Aug 26 06:17:09.075340 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 49/103] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:08 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:09.667187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a86e253b-e8f5-4d05-9914-4acb241f6de1 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:09.667807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a86e253b-e8f5-4d05-9914-4acb241f6de1 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:09.671985 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6f9c58ab-f430-4ffe-97c0-db2d94b7ecf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:09.673113 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6f9c58ab-f430-4ffe-97c0-db2d94b7ecf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:09.674341 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a86e253b-e8f5-4d05-9914-4acb241f6de1 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:09.674711 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a86e253b-e8f5-4d05-9914-4acb241f6de1 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:09.675496 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a86e253b-e8f5-4d05-9914-4acb241f6de1 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:09.676347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a86e253b-e8f5-4d05-9914-4acb241f6de1 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:09.676951 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a86e253b-e8f5-4d05-9914-4acb241f6de1 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:09.677550 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a86e253b-e8f5-4d05-9914-4acb241f6de1 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:09.687180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f9c58ab-f430-4ffe-97c0-db2d94b7ecf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:09.688642 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f9c58ab-f430-4ffe-97c0-db2d94b7ecf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:09.688921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f9c58ab-f430-4ffe-97c0-db2d94b7ecf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:09.689899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f9c58ab-f430-4ffe-97c0-db2d94b7ecf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:09.690905 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f9c58ab-f430-4ffe-97c0-db2d94b7ecf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:09.691490 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f9c58ab-f430-4ffe-97c0-db2d94b7ecf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:09.855178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a86e253b-e8f5-4d05-9914-4acb241f6de1 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:09.864537 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a86e253b-e8f5-4d05-9914-4acb241f6de1 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.208346 Aug 26 06:17:09.866794 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 55/104] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:09 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:09.898788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6f9c58ab-f430-4ffe-97c0-db2d94b7ecf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:09.907832 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6f9c58ab-f430-4ffe-97c0-db2d94b7ecf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.248888 Aug 26 06:17:09.908845 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 50/105] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:09 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:10.099205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ac4e0554-ef97-41cd-9bf0-d0ad7f8f7c71 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:10.100279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ac4e0554-ef97-41cd-9bf0-d0ad7f8f7c71 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:10.110531 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac4e0554-ef97-41cd-9bf0-d0ad7f8f7c71 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:10.111431 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac4e0554-ef97-41cd-9bf0-d0ad7f8f7c71 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:10.115171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac4e0554-ef97-41cd-9bf0-d0ad7f8f7c71 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:10.117266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac4e0554-ef97-41cd-9bf0-d0ad7f8f7c71 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:10.118424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac4e0554-ef97-41cd-9bf0-d0ad7f8f7c71 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:10.119805 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac4e0554-ef97-41cd-9bf0-d0ad7f8f7c71 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:10.333509 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ac4e0554-ef97-41cd-9bf0-d0ad7f8f7c71 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:10.343763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ac4e0554-ef97-41cd-9bf0-d0ad7f8f7c71 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.248709 Aug 26 06:17:10.344337 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 56/106] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:10 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:10.899463 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cb371b81-c2ab-4a4f-900f-1aa3c036701a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:10.900776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-cb371b81-c2ab-4a4f-900f-1aa3c036701a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:10.909645 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb371b81-c2ab-4a4f-900f-1aa3c036701a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:10.910807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb371b81-c2ab-4a4f-900f-1aa3c036701a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:10.911582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb371b81-c2ab-4a4f-900f-1aa3c036701a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:10.912605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb371b81-c2ab-4a4f-900f-1aa3c036701a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:10.913267 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb371b81-c2ab-4a4f-900f-1aa3c036701a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:10.913699 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb371b81-c2ab-4a4f-900f-1aa3c036701a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:10.935131 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-abd33389-9761-43c1-8986-c910a6c42898 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:10.936617 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-abd33389-9761-43c1-8986-c910a6c42898 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:10.945062 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-abd33389-9761-43c1-8986-c910a6c42898 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:10.945599 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-abd33389-9761-43c1-8986-c910a6c42898 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:10.946051 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-abd33389-9761-43c1-8986-c910a6c42898 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:10.946790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-abd33389-9761-43c1-8986-c910a6c42898 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:10.947247 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-abd33389-9761-43c1-8986-c910a6c42898 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:10.947670 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-abd33389-9761-43c1-8986-c910a6c42898 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:11.099172 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cb371b81-c2ab-4a4f-900f-1aa3c036701a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:11.110725 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cb371b81-c2ab-4a4f-900f-1aa3c036701a tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.224841 Aug 26 06:17:11.112524 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 51/107] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:10 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:11.198612 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-abd33389-9761-43c1-8986-c910a6c42898 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:11.221514 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-abd33389-9761-43c1-8986-c910a6c42898 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.290925 Aug 26 06:17:11.222906 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 57/108] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:10 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:11.370304 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-df760776-9347-4177-8017-4b9469c076c1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:11.371747 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-df760776-9347-4177-8017-4b9469c076c1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:11.404350 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df760776-9347-4177-8017-4b9469c076c1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:11.404853 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df760776-9347-4177-8017-4b9469c076c1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:11.405296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df760776-9347-4177-8017-4b9469c076c1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:11.406166 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df760776-9347-4177-8017-4b9469c076c1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:11.406796 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df760776-9347-4177-8017-4b9469c076c1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:11.407504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df760776-9347-4177-8017-4b9469c076c1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:11.642588 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-df760776-9347-4177-8017-4b9469c076c1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:11.651057 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-df760776-9347-4177-8017-4b9469c076c1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.288868 Aug 26 06:17:11.651655 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 52/109] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:11 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:12.138816 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-527f5972-ceba-4b5e-9e77-460945adc1fe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:12.138816 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-527f5972-ceba-4b5e-9e77-460945adc1fe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:12.146567 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-527f5972-ceba-4b5e-9e77-460945adc1fe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:12.147130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-527f5972-ceba-4b5e-9e77-460945adc1fe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:12.147627 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-527f5972-ceba-4b5e-9e77-460945adc1fe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:12.148765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-527f5972-ceba-4b5e-9e77-460945adc1fe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:12.149344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-527f5972-ceba-4b5e-9e77-460945adc1fe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:12.149880 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-527f5972-ceba-4b5e-9e77-460945adc1fe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:12.248547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-36fcfc64-a628-4796-90d6-9ae32a4e303d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:12.249322 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-36fcfc64-a628-4796-90d6-9ae32a4e303d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:12.255561 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36fcfc64-a628-4796-90d6-9ae32a4e303d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:12.256939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36fcfc64-a628-4796-90d6-9ae32a4e303d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:12.257405 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36fcfc64-a628-4796-90d6-9ae32a4e303d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:12.258242 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36fcfc64-a628-4796-90d6-9ae32a4e303d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:12.258854 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36fcfc64-a628-4796-90d6-9ae32a4e303d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:12.259165 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36fcfc64-a628-4796-90d6-9ae32a4e303d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:12.344121 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-527f5972-ceba-4b5e-9e77-460945adc1fe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:12.355861 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-527f5972-ceba-4b5e-9e77-460945adc1fe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.221850 Aug 26 06:17:12.357022 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 58/110] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:12 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:12.472722 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-36fcfc64-a628-4796-90d6-9ae32a4e303d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:12.481805 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-36fcfc64-a628-4796-90d6-9ae32a4e303d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.238849 Aug 26 06:17:12.482994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 53/111] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:12 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:12.682890 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c44c5fd7-5795-4226-84ac-0bddfdd74f8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:12.683757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c44c5fd7-5795-4226-84ac-0bddfdd74f8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:12.689901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c44c5fd7-5795-4226-84ac-0bddfdd74f8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:12.690395 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c44c5fd7-5795-4226-84ac-0bddfdd74f8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:12.690876 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c44c5fd7-5795-4226-84ac-0bddfdd74f8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:12.691669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c44c5fd7-5795-4226-84ac-0bddfdd74f8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:12.692133 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c44c5fd7-5795-4226-84ac-0bddfdd74f8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:12.692561 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c44c5fd7-5795-4226-84ac-0bddfdd74f8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:12.858758 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c44c5fd7-5795-4226-84ac-0bddfdd74f8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:12.872407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c44c5fd7-5795-4226-84ac-0bddfdd74f8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.194035 Aug 26 06:17:12.873576 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 59/112] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:12 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:13.386922 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3c7b8abc-3d02-4cf5-8d07-78d8ebb4eeb2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:13.387613 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3c7b8abc-3d02-4cf5-8d07-78d8ebb4eeb2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:13.393679 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c7b8abc-3d02-4cf5-8d07-78d8ebb4eeb2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:13.394167 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c7b8abc-3d02-4cf5-8d07-78d8ebb4eeb2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:13.394609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c7b8abc-3d02-4cf5-8d07-78d8ebb4eeb2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:13.395339 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c7b8abc-3d02-4cf5-8d07-78d8ebb4eeb2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:13.395794 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c7b8abc-3d02-4cf5-8d07-78d8ebb4eeb2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:13.396219 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c7b8abc-3d02-4cf5-8d07-78d8ebb4eeb2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:13.521433 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2c78cfef-ba72-47ce-bc63-368743dbffd1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:13.522080 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2c78cfef-ba72-47ce-bc63-368743dbffd1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:13.528583 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c78cfef-ba72-47ce-bc63-368743dbffd1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:13.529064 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c78cfef-ba72-47ce-bc63-368743dbffd1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:13.529521 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c78cfef-ba72-47ce-bc63-368743dbffd1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:13.530289 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c78cfef-ba72-47ce-bc63-368743dbffd1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:13.532262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c78cfef-ba72-47ce-bc63-368743dbffd1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:13.532262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c78cfef-ba72-47ce-bc63-368743dbffd1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:13.550060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3c7b8abc-3d02-4cf5-8d07-78d8ebb4eeb2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:13.562297 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3c7b8abc-3d02-4cf5-8d07-78d8ebb4eeb2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.181677 Aug 26 06:17:13.563138 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 54/113] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:13 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:13.699281 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2c78cfef-ba72-47ce-bc63-368743dbffd1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:13.707830 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2c78cfef-ba72-47ce-bc63-368743dbffd1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.190749 Aug 26 06:17:13.708404 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 60/114] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:13 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:13.918799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-90563da5-2b3f-4c20-a2a8-eb8d555327f8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:13.926468 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-90563da5-2b3f-4c20-a2a8-eb8d555327f8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:13.929599 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90563da5-2b3f-4c20-a2a8-eb8d555327f8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:13.930347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90563da5-2b3f-4c20-a2a8-eb8d555327f8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:13.931050 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90563da5-2b3f-4c20-a2a8-eb8d555327f8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:13.931960 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90563da5-2b3f-4c20-a2a8-eb8d555327f8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:13.932425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90563da5-2b3f-4c20-a2a8-eb8d555327f8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:13.932850 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90563da5-2b3f-4c20-a2a8-eb8d555327f8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:14.144328 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-90563da5-2b3f-4c20-a2a8-eb8d555327f8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:14.157505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-90563da5-2b3f-4c20-a2a8-eb8d555327f8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.246491 Aug 26 06:17:14.158254 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 55/115] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:13 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:14.593270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4c4d3b7b-1866-4cf3-9f3b-82a9d4a2e846 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:14.593883 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4c4d3b7b-1866-4cf3-9f3b-82a9d4a2e846 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:14.601407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c4d3b7b-1866-4cf3-9f3b-82a9d4a2e846 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:14.601900 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c4d3b7b-1866-4cf3-9f3b-82a9d4a2e846 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:14.602341 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c4d3b7b-1866-4cf3-9f3b-82a9d4a2e846 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:14.603078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c4d3b7b-1866-4cf3-9f3b-82a9d4a2e846 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:14.603538 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c4d3b7b-1866-4cf3-9f3b-82a9d4a2e846 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:14.603959 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c4d3b7b-1866-4cf3-9f3b-82a9d4a2e846 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:14.764140 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f52ded82-f8f0-4f52-b633-1471f8745e1d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:14.766248 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f52ded82-f8f0-4f52-b633-1471f8745e1d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:14.776637 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4c4d3b7b-1866-4cf3-9f3b-82a9d4a2e846 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:14.779896 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f52ded82-f8f0-4f52-b633-1471f8745e1d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:14.780899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f52ded82-f8f0-4f52-b633-1471f8745e1d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:14.781874 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f52ded82-f8f0-4f52-b633-1471f8745e1d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:14.782092 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:14.783598 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f52ded82-f8f0-4f52-b633-1471f8745e1d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:14.784712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f52ded82-f8f0-4f52-b633-1471f8745e1d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:14.785604 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f52ded82-f8f0-4f52-b633-1471f8745e1d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:14.790861 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4c4d3b7b-1866-4cf3-9f3b-82a9d4a2e846 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.201262 Aug 26 06:17:14.791797 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 61/116] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:14 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:14.903511 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-49cb2976-594a-4df5-82fd-fba0bff8fa0c req-50cb266e-2052-42a0-9038-a68ba06afd8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3647fa12-4de4-4b81-aca1-4687ec0af8f9", "name": "network-vif-plugged", "status": "completed", "tag": "25e49a9c-7d0c-440b-b98b-c8b9503ba03f"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:17:14.959059 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-49cb2976-594a-4df5-82fd-fba0bff8fa0c req-50cb266e-2052-42a0-9038-a68ba06afd8a service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:14.959059 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-49cb2976-594a-4df5-82fd-fba0bff8fa0c req-50cb266e-2052-42a0-9038-a68ba06afd8a service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:14.959059 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-49cb2976-594a-4df5-82fd-fba0bff8fa0c req-50cb266e-2052-42a0-9038-a68ba06afd8a service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:14.964412 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-49cb2976-594a-4df5-82fd-fba0bff8fa0c req-50cb266e-2052-42a0-9038-a68ba06afd8a service nova] Creating event network-vif-plugged:25e49a9c-7d0c-440b-b98b-c8b9503ba03f for instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 on hv-cinder-85391 Aug 26 06:17:14.971128 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-49cb2976-594a-4df5-82fd-fba0bff8fa0c req-50cb266e-2052-42a0-9038-a68ba06afd8a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162844 Aug 26 06:17:14.972209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 62/117] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:17:15.007514 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f52ded82-f8f0-4f52-b633-1471f8745e1d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:15.016926 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f52ded82-f8f0-4f52-b633-1471f8745e1d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.279484 Aug 26 06:17:15.018804 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 56/118] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:14 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:15.184503 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-de046307-f824-4b7f-b9aa-5d73366c531e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:15.185528 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-de046307-f824-4b7f-b9aa-5d73366c531e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:15.198109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de046307-f824-4b7f-b9aa-5d73366c531e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:15.198603 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de046307-f824-4b7f-b9aa-5d73366c531e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:15.199351 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de046307-f824-4b7f-b9aa-5d73366c531e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:15.200206 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de046307-f824-4b7f-b9aa-5d73366c531e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:15.200491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de046307-f824-4b7f-b9aa-5d73366c531e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:15.201060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de046307-f824-4b7f-b9aa-5d73366c531e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:15.372394 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-de046307-f824-4b7f-b9aa-5d73366c531e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:15.380304 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-de046307-f824-4b7f-b9aa-5d73366c531e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.202165 Aug 26 06:17:15.380868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 63/119] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:15 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:15.813206 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0c1066e2-c49d-418d-b3ef-82d7141058e9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:15.813920 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0c1066e2-c49d-418d-b3ef-82d7141058e9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:15.821239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0c1066e2-c49d-418d-b3ef-82d7141058e9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:15.822124 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0c1066e2-c49d-418d-b3ef-82d7141058e9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:15.823058 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0c1066e2-c49d-418d-b3ef-82d7141058e9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:15.823951 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0c1066e2-c49d-418d-b3ef-82d7141058e9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:15.824410 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0c1066e2-c49d-418d-b3ef-82d7141058e9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:15.825343 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0c1066e2-c49d-418d-b3ef-82d7141058e9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:15.991819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0c1066e2-c49d-418d-b3ef-82d7141058e9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:15.999575 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0c1066e2-c49d-418d-b3ef-82d7141058e9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.190115 Aug 26 06:17:16.000153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 57/120] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:15 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:16.057933 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0b71f98a-a4eb-4fe9-a922-a2fbb790d0f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:16.058536 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0b71f98a-a4eb-4fe9-a922-a2fbb790d0f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:16.064729 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0b71f98a-a4eb-4fe9-a922-a2fbb790d0f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:16.065204 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0b71f98a-a4eb-4fe9-a922-a2fbb790d0f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:16.065643 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0b71f98a-a4eb-4fe9-a922-a2fbb790d0f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:16.091635 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0b71f98a-a4eb-4fe9-a922-a2fbb790d0f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:16.091635 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0b71f98a-a4eb-4fe9-a922-a2fbb790d0f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:16.091635 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0b71f98a-a4eb-4fe9-a922-a2fbb790d0f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:16.281139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0b71f98a-a4eb-4fe9-a922-a2fbb790d0f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:16.281139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0b71f98a-a4eb-4fe9-a922-a2fbb790d0f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.177243 Aug 26 06:17:16.281139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 64/121] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:16 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:16.402553 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3b47b358-ad93-4676-8311-da9a439e5cac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:16.403031 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3b47b358-ad93-4676-8311-da9a439e5cac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:16.409903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3b47b358-ad93-4676-8311-da9a439e5cac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:16.410389 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3b47b358-ad93-4676-8311-da9a439e5cac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:16.410849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3b47b358-ad93-4676-8311-da9a439e5cac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:16.411542 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3b47b358-ad93-4676-8311-da9a439e5cac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:16.411986 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3b47b358-ad93-4676-8311-da9a439e5cac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:16.413065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3b47b358-ad93-4676-8311-da9a439e5cac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:16.559007 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3b47b358-ad93-4676-8311-da9a439e5cac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:16.567939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3b47b358-ad93-4676-8311-da9a439e5cac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.169404 Aug 26 06:17:16.568651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 58/122] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:16 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:17.025702 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5afafb63-7c70-4f17-b022-dd5a874220db tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:17.028337 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5afafb63-7c70-4f17-b022-dd5a874220db tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:17.035578 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5afafb63-7c70-4f17-b022-dd5a874220db tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:17.036303 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5afafb63-7c70-4f17-b022-dd5a874220db tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:17.036759 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5afafb63-7c70-4f17-b022-dd5a874220db tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:17.038243 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5afafb63-7c70-4f17-b022-dd5a874220db tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:17.038985 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5afafb63-7c70-4f17-b022-dd5a874220db tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:17.039510 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5afafb63-7c70-4f17-b022-dd5a874220db tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:17.183927 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5afafb63-7c70-4f17-b022-dd5a874220db tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:17.193456 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5afafb63-7c70-4f17-b022-dd5a874220db tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.175092 Aug 26 06:17:17.195388 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 65/123] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:17 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:17.265519 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7626b0bb-8cf6-492e-be01-313daed76a72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:17.266520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7626b0bb-8cf6-492e-be01-313daed76a72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:17.278925 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7626b0bb-8cf6-492e-be01-313daed76a72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:17.280484 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7626b0bb-8cf6-492e-be01-313daed76a72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:17.281597 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7626b0bb-8cf6-492e-be01-313daed76a72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:17.283067 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7626b0bb-8cf6-492e-be01-313daed76a72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:17.284210 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7626b0bb-8cf6-492e-be01-313daed76a72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:17.285309 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7626b0bb-8cf6-492e-be01-313daed76a72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:17.544620 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7626b0bb-8cf6-492e-be01-313daed76a72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:17.553966 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7626b0bb-8cf6-492e-be01-313daed76a72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.295168 Aug 26 06:17:17.561741 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 59/124] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:17 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:17.596094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9cf33777-b348-45aa-9a66-b98856079be5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:17.597347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9cf33777-b348-45aa-9a66-b98856079be5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:17.604007 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9cf33777-b348-45aa-9a66-b98856079be5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:17.604498 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9cf33777-b348-45aa-9a66-b98856079be5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:17.605035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9cf33777-b348-45aa-9a66-b98856079be5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:17.605742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9cf33777-b348-45aa-9a66-b98856079be5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:17.606196 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9cf33777-b348-45aa-9a66-b98856079be5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:17.606671 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9cf33777-b348-45aa-9a66-b98856079be5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:17.777359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9cf33777-b348-45aa-9a66-b98856079be5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:17.787193 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9cf33777-b348-45aa-9a66-b98856079be5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.194887 Aug 26 06:17:17.788375 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 66/125] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:17 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:18.219664 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e4c9fcc2-c5b4-4bd2-9977-90b0965211da tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:18.220335 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e4c9fcc2-c5b4-4bd2-9977-90b0965211da tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:18.227624 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4c9fcc2-c5b4-4bd2-9977-90b0965211da tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:18.228147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4c9fcc2-c5b4-4bd2-9977-90b0965211da tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:18.228584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4c9fcc2-c5b4-4bd2-9977-90b0965211da tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:18.229273 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4c9fcc2-c5b4-4bd2-9977-90b0965211da tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:18.229725 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4c9fcc2-c5b4-4bd2-9977-90b0965211da tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:18.230143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4c9fcc2-c5b4-4bd2-9977-90b0965211da tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:18.584154 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3fdc2dd3-8559-4831-b5b4-aaaab8bd2d6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:18.585390 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3fdc2dd3-8559-4831-b5b4-aaaab8bd2d6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:18.591260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fdc2dd3-8559-4831-b5b4-aaaab8bd2d6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:18.591732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fdc2dd3-8559-4831-b5b4-aaaab8bd2d6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:18.592641 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fdc2dd3-8559-4831-b5b4-aaaab8bd2d6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:18.593653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fdc2dd3-8559-4831-b5b4-aaaab8bd2d6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:18.594245 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fdc2dd3-8559-4831-b5b4-aaaab8bd2d6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:18.594838 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fdc2dd3-8559-4831-b5b4-aaaab8bd2d6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:18.616721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e4c9fcc2-c5b4-4bd2-9977-90b0965211da tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:18.626919 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e4c9fcc2-c5b4-4bd2-9977-90b0965211da tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.411188 Aug 26 06:17:18.627487 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 60/126] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:18 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:18.733046 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3fdc2dd3-8559-4831-b5b4-aaaab8bd2d6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:18.741703 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3fdc2dd3-8559-4831-b5b4-aaaab8bd2d6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.167881 Aug 26 06:17:18.742330 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 67/127] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:18 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:18.808664 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-67b6faf8-d45f-42f4-ae5e-d6798911effb tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:18.809346 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-67b6faf8-d45f-42f4-ae5e-d6798911effb tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:18.815577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-67b6faf8-d45f-42f4-ae5e-d6798911effb tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:18.816059 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-67b6faf8-d45f-42f4-ae5e-d6798911effb tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:18.816501 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-67b6faf8-d45f-42f4-ae5e-d6798911effb tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:18.817201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-67b6faf8-d45f-42f4-ae5e-d6798911effb tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:18.817654 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-67b6faf8-d45f-42f4-ae5e-d6798911effb tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:18.818078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-67b6faf8-d45f-42f4-ae5e-d6798911effb tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:19.004458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-67b6faf8-d45f-42f4-ae5e-d6798911effb tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:19.016547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-67b6faf8-d45f-42f4-ae5e-d6798911effb tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.211303 Aug 26 06:17:19.016853 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 61/128] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:18 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:19.649879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a00b389d-4536-4359-9101-5c01c9f64621 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:19.650404 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a00b389d-4536-4359-9101-5c01c9f64621 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:19.656831 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a00b389d-4536-4359-9101-5c01c9f64621 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:19.657320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a00b389d-4536-4359-9101-5c01c9f64621 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:19.657778 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a00b389d-4536-4359-9101-5c01c9f64621 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:19.658456 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a00b389d-4536-4359-9101-5c01c9f64621 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:19.658941 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a00b389d-4536-4359-9101-5c01c9f64621 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:19.659367 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a00b389d-4536-4359-9101-5c01c9f64621 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:19.764075 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-53138148-a024-46f0-a2a5-6e272bccffed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:19.764792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-53138148-a024-46f0-a2a5-6e272bccffed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:19.771331 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53138148-a024-46f0-a2a5-6e272bccffed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:19.772526 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53138148-a024-46f0-a2a5-6e272bccffed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:19.773205 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53138148-a024-46f0-a2a5-6e272bccffed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:19.773931 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53138148-a024-46f0-a2a5-6e272bccffed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:19.774387 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53138148-a024-46f0-a2a5-6e272bccffed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:19.774841 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53138148-a024-46f0-a2a5-6e272bccffed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:19.823596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a00b389d-4536-4359-9101-5c01c9f64621 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:19.835552 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a00b389d-4536-4359-9101-5c01c9f64621 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.190093 Aug 26 06:17:19.837182 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 68/129] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:19 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:19.934328 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-53138148-a024-46f0-a2a5-6e272bccffed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:19.936728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=100 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:19.943620 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-53138148-a024-46f0-a2a5-6e272bccffed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.183820 Aug 26 06:17:19.944556 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 62/130] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:19 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:20.038976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-18515bae-fb7b-40f6-8a63-ca2cc9acda2b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:20.039584 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-18515bae-fb7b-40f6-8a63-ca2cc9acda2b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:20.046017 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18515bae-fb7b-40f6-8a63-ca2cc9acda2b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:20.046495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18515bae-fb7b-40f6-8a63-ca2cc9acda2b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:20.046972 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18515bae-fb7b-40f6-8a63-ca2cc9acda2b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:20.047659 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18515bae-fb7b-40f6-8a63-ca2cc9acda2b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:20.048109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18515bae-fb7b-40f6-8a63-ca2cc9acda2b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:20.048533 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18515bae-fb7b-40f6-8a63-ca2cc9acda2b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:20.192554 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-18515bae-fb7b-40f6-8a63-ca2cc9acda2b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:20.201456 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-18515bae-fb7b-40f6-8a63-ca2cc9acda2b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.166848 Aug 26 06:17:20.202476 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 69/131] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:20 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:20.867813 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-68cc28c7-7b03-4058-8402-6ed8df01c8ab tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:20.868606 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-68cc28c7-7b03-4058-8402-6ed8df01c8ab tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:20.874750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68cc28c7-7b03-4058-8402-6ed8df01c8ab tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:20.875301 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68cc28c7-7b03-4058-8402-6ed8df01c8ab tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:20.875762 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68cc28c7-7b03-4058-8402-6ed8df01c8ab tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:20.876484 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68cc28c7-7b03-4058-8402-6ed8df01c8ab tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:20.876940 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68cc28c7-7b03-4058-8402-6ed8df01c8ab tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:20.877365 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68cc28c7-7b03-4058-8402-6ed8df01c8ab tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:20.965354 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-11305ff6-e5f9-4a02-aed6-b7404897b864 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:20.966048 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-11305ff6-e5f9-4a02-aed6-b7404897b864 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:20.972672 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11305ff6-e5f9-4a02-aed6-b7404897b864 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:20.973286 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11305ff6-e5f9-4a02-aed6-b7404897b864 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:20.973756 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11305ff6-e5f9-4a02-aed6-b7404897b864 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:20.975426 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11305ff6-e5f9-4a02-aed6-b7404897b864 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:20.976307 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11305ff6-e5f9-4a02-aed6-b7404897b864 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:20.976957 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11305ff6-e5f9-4a02-aed6-b7404897b864 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:21.029190 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-68cc28c7-7b03-4058-8402-6ed8df01c8ab tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:21.049147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-68cc28c7-7b03-4058-8402-6ed8df01c8ab tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.182407 Aug 26 06:17:21.049147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 63/132] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:20 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:21.140096 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-11305ff6-e5f9-4a02-aed6-b7404897b864 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:21.148079 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-11305ff6-e5f9-4a02-aed6-b7404897b864 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.186709 Aug 26 06:17:21.148643 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 70/133] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:20 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:21.222743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e896d7b6-3e3e-4aa3-86f8-2cc3d93643e2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:21.223264 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e896d7b6-3e3e-4aa3-86f8-2cc3d93643e2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:21.230032 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e896d7b6-3e3e-4aa3-86f8-2cc3d93643e2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:21.230508 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e896d7b6-3e3e-4aa3-86f8-2cc3d93643e2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:21.230969 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e896d7b6-3e3e-4aa3-86f8-2cc3d93643e2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:21.231667 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e896d7b6-3e3e-4aa3-86f8-2cc3d93643e2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:21.232113 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e896d7b6-3e3e-4aa3-86f8-2cc3d93643e2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:21.232558 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e896d7b6-3e3e-4aa3-86f8-2cc3d93643e2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:21.366792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e896d7b6-3e3e-4aa3-86f8-2cc3d93643e2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:21.374578 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e896d7b6-3e3e-4aa3-86f8-2cc3d93643e2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.155827 Aug 26 06:17:21.375162 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 64/134] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:21 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:22.069724 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ff0c6c2d-500a-4234-b865-ec2645c3b8eb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:22.070784 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ff0c6c2d-500a-4234-b865-ec2645c3b8eb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:22.077023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff0c6c2d-500a-4234-b865-ec2645c3b8eb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:22.077499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff0c6c2d-500a-4234-b865-ec2645c3b8eb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:22.077992 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff0c6c2d-500a-4234-b865-ec2645c3b8eb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:22.078716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff0c6c2d-500a-4234-b865-ec2645c3b8eb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:22.081629 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff0c6c2d-500a-4234-b865-ec2645c3b8eb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:22.081629 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff0c6c2d-500a-4234-b865-ec2645c3b8eb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:22.174064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e121ab08-f6c3-4c52-b10d-834430b023d2 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:22.175619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e121ab08-f6c3-4c52-b10d-834430b023d2 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:22.183552 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e121ab08-f6c3-4c52-b10d-834430b023d2 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:22.184041 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e121ab08-f6c3-4c52-b10d-834430b023d2 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:22.184468 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e121ab08-f6c3-4c52-b10d-834430b023d2 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:22.185345 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e121ab08-f6c3-4c52-b10d-834430b023d2 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:22.185786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e121ab08-f6c3-4c52-b10d-834430b023d2 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:22.186201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e121ab08-f6c3-4c52-b10d-834430b023d2 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:22.246810 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ff0c6c2d-500a-4234-b865-ec2645c3b8eb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:22.255297 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ff0c6c2d-500a-4234-b865-ec2645c3b8eb tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.191196 Aug 26 06:17:22.256286 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 71/135] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:22 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:22.329107 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e121ab08-f6c3-4c52-b10d-834430b023d2 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:22.341143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e121ab08-f6c3-4c52-b10d-834430b023d2 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.171250 Aug 26 06:17:22.342113 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 65/136] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:22 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:22.395846 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dd0c3575-18f9-45b7-a59a-9faca7fa33da tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:22.396469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-dd0c3575-18f9-45b7-a59a-9faca7fa33da tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:22.422959 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd0c3575-18f9-45b7-a59a-9faca7fa33da tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:22.422959 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd0c3575-18f9-45b7-a59a-9faca7fa33da tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:22.422959 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd0c3575-18f9-45b7-a59a-9faca7fa33da tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:22.422959 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd0c3575-18f9-45b7-a59a-9faca7fa33da tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:22.423458 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd0c3575-18f9-45b7-a59a-9faca7fa33da tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:22.423458 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd0c3575-18f9-45b7-a59a-9faca7fa33da tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:22.562790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-dd0c3575-18f9-45b7-a59a-9faca7fa33da tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:22.571535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-dd0c3575-18f9-45b7-a59a-9faca7fa33da tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.179746 Aug 26 06:17:22.572113 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 72/137] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:22 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:23.278812 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-43164e78-0b19-4680-b0c6-f74ea09edbe2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:23.279407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-43164e78-0b19-4680-b0c6-f74ea09edbe2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:23.285453 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43164e78-0b19-4680-b0c6-f74ea09edbe2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:23.285907 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43164e78-0b19-4680-b0c6-f74ea09edbe2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:23.286335 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43164e78-0b19-4680-b0c6-f74ea09edbe2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:23.287042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43164e78-0b19-4680-b0c6-f74ea09edbe2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:23.287536 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43164e78-0b19-4680-b0c6-f74ea09edbe2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:23.287950 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43164e78-0b19-4680-b0c6-f74ea09edbe2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:23.363473 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3424ca94-2f8d-46a3-bc8e-5be4bf6f1f2f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:23.364021 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3424ca94-2f8d-46a3-bc8e-5be4bf6f1f2f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:23.373161 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3424ca94-2f8d-46a3-bc8e-5be4bf6f1f2f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:23.374043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3424ca94-2f8d-46a3-bc8e-5be4bf6f1f2f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:23.374597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3424ca94-2f8d-46a3-bc8e-5be4bf6f1f2f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:23.375524 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3424ca94-2f8d-46a3-bc8e-5be4bf6f1f2f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:23.376051 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3424ca94-2f8d-46a3-bc8e-5be4bf6f1f2f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:23.376546 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3424ca94-2f8d-46a3-bc8e-5be4bf6f1f2f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:23.445614 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-43164e78-0b19-4680-b0c6-f74ea09edbe2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:23.468418 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-43164e78-0b19-4680-b0c6-f74ea09edbe2 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.193196 Aug 26 06:17:23.469052 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 66/138] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:23 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:23.546451 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3424ca94-2f8d-46a3-bc8e-5be4bf6f1f2f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:23.555481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3424ca94-2f8d-46a3-bc8e-5be4bf6f1f2f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.195841 Aug 26 06:17:23.556091 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 73/139] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:23 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:23.596784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c27eeb52-ae71-4014-9281-9d15a37ee310 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:23.597430 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c27eeb52-ae71-4014-9281-9d15a37ee310 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:23.604122 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c27eeb52-ae71-4014-9281-9d15a37ee310 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:23.604610 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c27eeb52-ae71-4014-9281-9d15a37ee310 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:23.605044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c27eeb52-ae71-4014-9281-9d15a37ee310 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:23.605743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c27eeb52-ae71-4014-9281-9d15a37ee310 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:23.606191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c27eeb52-ae71-4014-9281-9d15a37ee310 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:23.606629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c27eeb52-ae71-4014-9281-9d15a37ee310 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:23.757762 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c27eeb52-ae71-4014-9281-9d15a37ee310 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:23.765876 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c27eeb52-ae71-4014-9281-9d15a37ee310 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.173249 Aug 26 06:17:23.766456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 67/140] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:23 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:24.577945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0962ec3b-9955-413a-83cd-87283ab1090b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:24.577945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0962ec3b-9955-413a-83cd-87283ab1090b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:24.577945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0962ec3b-9955-413a-83cd-87283ab1090b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:24.577945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0962ec3b-9955-413a-83cd-87283ab1090b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:24.578648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0962ec3b-9955-413a-83cd-87283ab1090b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:24.578648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0962ec3b-9955-413a-83cd-87283ab1090b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:24.578648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0962ec3b-9955-413a-83cd-87283ab1090b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:24.578648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0962ec3b-9955-413a-83cd-87283ab1090b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:24.588052 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ebdc9ac0-41b8-408d-9f27-557c632b89ee tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:24.589154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ebdc9ac0-41b8-408d-9f27-557c632b89ee tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:24.597204 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ebdc9ac0-41b8-408d-9f27-557c632b89ee tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:24.598560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ebdc9ac0-41b8-408d-9f27-557c632b89ee tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:24.599419 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ebdc9ac0-41b8-408d-9f27-557c632b89ee tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:24.600961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ebdc9ac0-41b8-408d-9f27-557c632b89ee tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:24.601612 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ebdc9ac0-41b8-408d-9f27-557c632b89ee tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:24.602183 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ebdc9ac0-41b8-408d-9f27-557c632b89ee tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:24.733747 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0962ec3b-9955-413a-83cd-87283ab1090b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:24.744129 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0962ec3b-9955-413a-83cd-87283ab1090b tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.245500 Aug 26 06:17:24.744705 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 74/141] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:24 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:24.749493 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-5b2cbe30-e311-417d-8607-0d82e26a18bb req-a216d6e8-c9d0-495e-ac72-77a6007a950c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012ac1bd-a390-4776-841b-f11f736a3d9f", "name": "network-vif-plugged", "status": "completed", "tag": "e7a88b0e-f6e1-473e-9018-7ee3f4181af9"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:17:24.760502 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-5b2cbe30-e311-417d-8607-0d82e26a18bb req-a216d6e8-c9d0-495e-ac72-77a6007a950c service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:24.761383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-5b2cbe30-e311-417d-8607-0d82e26a18bb req-a216d6e8-c9d0-495e-ac72-77a6007a950c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:24.762205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-5b2cbe30-e311-417d-8607-0d82e26a18bb req-a216d6e8-c9d0-495e-ac72-77a6007a950c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:24.777049 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-5b2cbe30-e311-417d-8607-0d82e26a18bb req-a216d6e8-c9d0-495e-ac72-77a6007a950c service nova] Creating event network-vif-plugged:e7a88b0e-f6e1-473e-9018-7ee3f4181af9 for instance 012ac1bd-a390-4776-841b-f11f736a3d9f on hv-cinder-85391 Aug 26 06:17:24.783251 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-5b2cbe30-e311-417d-8607-0d82e26a18bb req-a216d6e8-c9d0-495e-ac72-77a6007a950c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036741 Aug 26 06:17:24.784322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 75/142] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:17:24.791580 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ebdc9ac0-41b8-408d-9f27-557c632b89ee tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:24.791841 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d59a95cf-5f72-47f2-a206-8ec7207227c9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:24.793251 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d59a95cf-5f72-47f2-a206-8ec7207227c9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:24.799771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ebdc9ac0-41b8-408d-9f27-557c632b89ee tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.221689 Aug 26 06:17:24.799949 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d59a95cf-5f72-47f2-a206-8ec7207227c9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:24.800412 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d59a95cf-5f72-47f2-a206-8ec7207227c9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:24.800702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 68/143] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:24 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:24.800885 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d59a95cf-5f72-47f2-a206-8ec7207227c9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:24.801666 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d59a95cf-5f72-47f2-a206-8ec7207227c9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:24.802161 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d59a95cf-5f72-47f2-a206-8ec7207227c9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:24.802644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d59a95cf-5f72-47f2-a206-8ec7207227c9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:24.961708 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d59a95cf-5f72-47f2-a206-8ec7207227c9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:24.972606 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d59a95cf-5f72-47f2-a206-8ec7207227c9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.186779 Aug 26 06:17:24.973187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 76/144] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:24 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:25.769450 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e8fbee35-fcd6-41ac-b6e8-21e406df30ee tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:25.770056 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e8fbee35-fcd6-41ac-b6e8-21e406df30ee tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:25.776813 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e8fbee35-fcd6-41ac-b6e8-21e406df30ee tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:25.777294 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e8fbee35-fcd6-41ac-b6e8-21e406df30ee tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:25.777727 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e8fbee35-fcd6-41ac-b6e8-21e406df30ee tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:25.778523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e8fbee35-fcd6-41ac-b6e8-21e406df30ee tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:25.779011 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e8fbee35-fcd6-41ac-b6e8-21e406df30ee tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:25.779433 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e8fbee35-fcd6-41ac-b6e8-21e406df30ee tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:25.826139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-710cdc3e-d97c-45ee-a747-6134dcb1ff21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:25.828483 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-710cdc3e-d97c-45ee-a747-6134dcb1ff21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:25.833154 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-710cdc3e-d97c-45ee-a747-6134dcb1ff21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:25.833744 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-710cdc3e-d97c-45ee-a747-6134dcb1ff21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:25.835198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-710cdc3e-d97c-45ee-a747-6134dcb1ff21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:25.836203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-710cdc3e-d97c-45ee-a747-6134dcb1ff21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:25.836581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-710cdc3e-d97c-45ee-a747-6134dcb1ff21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:25.837004 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-710cdc3e-d97c-45ee-a747-6134dcb1ff21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:25.940939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e8fbee35-fcd6-41ac-b6e8-21e406df30ee tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:25.949600 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e8fbee35-fcd6-41ac-b6e8-21e406df30ee tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.183893 Aug 26 06:17:25.950192 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 69/145] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:25 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:25.999530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-710cdc3e-d97c-45ee-a747-6134dcb1ff21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:26.007985 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-710cdc3e-d97c-45ee-a747-6134dcb1ff21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.187052 Aug 26 06:17:26.008216 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-76b9d519-0ce8-423b-89d0-98fa15f17b69 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:26.008569 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 77/146] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:25 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:26.009325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-76b9d519-0ce8-423b-89d0-98fa15f17b69 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:26.019548 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76b9d519-0ce8-423b-89d0-98fa15f17b69 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:26.020480 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76b9d519-0ce8-423b-89d0-98fa15f17b69 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:26.021407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76b9d519-0ce8-423b-89d0-98fa15f17b69 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:26.023899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76b9d519-0ce8-423b-89d0-98fa15f17b69 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:26.024412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76b9d519-0ce8-423b-89d0-98fa15f17b69 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:26.024857 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76b9d519-0ce8-423b-89d0-98fa15f17b69 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:26.202559 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-76b9d519-0ce8-423b-89d0-98fa15f17b69 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:26.215995 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-76b9d519-0ce8-423b-89d0-98fa15f17b69 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.215082 Aug 26 06:17:26.216755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 70/147] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:25 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:26.802722 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-4733ffed-e86e-4dfe-a9b6-3df49a0008a2 req-22336d47-60b2-412f-8ed9-f0bfcda27026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0dda9da-e7bd-4a7d-b807-a2074ccbe208", "name": "network-vif-plugged", "status": "completed", "tag": "eb6ebb39-9a85-4eaa-88a1-9d3aff9f8785"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:17:26.813265 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-4733ffed-e86e-4dfe-a9b6-3df49a0008a2 req-22336d47-60b2-412f-8ed9-f0bfcda27026 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:26.813753 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-4733ffed-e86e-4dfe-a9b6-3df49a0008a2 req-22336d47-60b2-412f-8ed9-f0bfcda27026 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:26.814183 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-4733ffed-e86e-4dfe-a9b6-3df49a0008a2 req-22336d47-60b2-412f-8ed9-f0bfcda27026 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:26.827581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-4733ffed-e86e-4dfe-a9b6-3df49a0008a2 req-22336d47-60b2-412f-8ed9-f0bfcda27026 service nova] Creating event network-vif-plugged:eb6ebb39-9a85-4eaa-88a1-9d3aff9f8785 for instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 on hv-cinder-85391 Aug 26 06:17:26.832534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-4733ffed-e86e-4dfe-a9b6-3df49a0008a2 req-22336d47-60b2-412f-8ed9-f0bfcda27026 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035040 Aug 26 06:17:26.833600 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 78/148] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:17:26.976007 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7c0a5bd4-bff1-4b13-8a56-b15139a2a32f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:26.977059 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7c0a5bd4-bff1-4b13-8a56-b15139a2a32f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:26.983596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c0a5bd4-bff1-4b13-8a56-b15139a2a32f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:26.984067 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c0a5bd4-bff1-4b13-8a56-b15139a2a32f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:26.984490 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c0a5bd4-bff1-4b13-8a56-b15139a2a32f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:26.985174 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c0a5bd4-bff1-4b13-8a56-b15139a2a32f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:26.985616 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c0a5bd4-bff1-4b13-8a56-b15139a2a32f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:26.986033 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c0a5bd4-bff1-4b13-8a56-b15139a2a32f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:27.047147 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-566ec3ed-f7c9-437b-ad05-5aa2e1fc1248 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:27.047867 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-566ec3ed-f7c9-437b-ad05-5aa2e1fc1248 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:27.071659 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-566ec3ed-f7c9-437b-ad05-5aa2e1fc1248 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:27.072498 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-566ec3ed-f7c9-437b-ad05-5aa2e1fc1248 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:27.073268 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-566ec3ed-f7c9-437b-ad05-5aa2e1fc1248 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:27.074832 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-566ec3ed-f7c9-437b-ad05-5aa2e1fc1248 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:27.075909 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-566ec3ed-f7c9-437b-ad05-5aa2e1fc1248 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:27.076698 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-566ec3ed-f7c9-437b-ad05-5aa2e1fc1248 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:27.226231 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7c0a5bd4-bff1-4b13-8a56-b15139a2a32f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:27.239783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7c0a5bd4-bff1-4b13-8a56-b15139a2a32f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1315 microversion: 2.1 time: 0.269498 Aug 26 06:17:27.240166 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 71/149] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:26 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:27.247148 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-11026a81-e174-46d0-9e9e-b9f10ca29cbc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:27.253893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-11026a81-e174-46d0-9e9e-b9f10ca29cbc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:27.278436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11026a81-e174-46d0-9e9e-b9f10ca29cbc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:27.278436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11026a81-e174-46d0-9e9e-b9f10ca29cbc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:27.278436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11026a81-e174-46d0-9e9e-b9f10ca29cbc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:27.278436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11026a81-e174-46d0-9e9e-b9f10ca29cbc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:27.279016 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11026a81-e174-46d0-9e9e-b9f10ca29cbc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:27.279016 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11026a81-e174-46d0-9e9e-b9f10ca29cbc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:27.303318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-566ec3ed-f7c9-437b-ad05-5aa2e1fc1248 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:27.315991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-566ec3ed-f7c9-437b-ad05-5aa2e1fc1248 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.277318 Aug 26 06:17:27.319115 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 79/150] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:27 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:27.476044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-11026a81-e174-46d0-9e9e-b9f10ca29cbc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:27.486639 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-11026a81-e174-46d0-9e9e-b9f10ca29cbc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.244420 Aug 26 06:17:27.487331 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 72/151] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:27 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:28.264129 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1e972b5d-3979-4efb-99ef-ccccd0978ad0 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:28.264818 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1e972b5d-3979-4efb-99ef-ccccd0978ad0 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:28.270912 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e972b5d-3979-4efb-99ef-ccccd0978ad0 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:28.271401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e972b5d-3979-4efb-99ef-ccccd0978ad0 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:28.271837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e972b5d-3979-4efb-99ef-ccccd0978ad0 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:28.272531 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e972b5d-3979-4efb-99ef-ccccd0978ad0 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:28.272986 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e972b5d-3979-4efb-99ef-ccccd0978ad0 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:28.273402 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e972b5d-3979-4efb-99ef-ccccd0978ad0 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:28.292707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:28.344856 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-22ceb821-5e95-4be1-b801-14e8a8011f8f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:28.349512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-22ceb821-5e95-4be1-b801-14e8a8011f8f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:28.356198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ceb821-5e95-4be1-b801-14e8a8011f8f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:28.356961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ceb821-5e95-4be1-b801-14e8a8011f8f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:28.357404 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ceb821-5e95-4be1-b801-14e8a8011f8f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:28.358429 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ceb821-5e95-4be1-b801-14e8a8011f8f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:28.359975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ceb821-5e95-4be1-b801-14e8a8011f8f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:28.362806 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ceb821-5e95-4be1-b801-14e8a8011f8f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:28.456595 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1e972b5d-3979-4efb-99ef-ccccd0978ad0 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:28.470487 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1e972b5d-3979-4efb-99ef-ccccd0978ad0 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1502 microversion: 2.1 time: 0.210337 Aug 26 06:17:28.471112 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 80/152] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:28 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:28.507739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b7ba3ed0-944c-476a-a536-fc63f5c74737 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:28.508598 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b7ba3ed0-944c-476a-a536-fc63f5c74737 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:28.514806 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7ba3ed0-944c-476a-a536-fc63f5c74737 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:28.515791 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7ba3ed0-944c-476a-a536-fc63f5c74737 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:28.516642 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7ba3ed0-944c-476a-a536-fc63f5c74737 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:28.517575 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7ba3ed0-944c-476a-a536-fc63f5c74737 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:28.518102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7ba3ed0-944c-476a-a536-fc63f5c74737 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:28.518834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7ba3ed0-944c-476a-a536-fc63f5c74737 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:28.620001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-22ceb821-5e95-4be1-b801-14e8a8011f8f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:28.628770 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-22ceb821-5e95-4be1-b801-14e8a8011f8f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.288476 Aug 26 06:17:28.629447 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 73/153] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:28 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:28.684355 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b7ba3ed0-944c-476a-a536-fc63f5c74737 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:28.692016 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b7ba3ed0-944c-476a-a536-fc63f5c74737 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.188216 Aug 26 06:17:28.692592 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 81/154] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:28 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:28.850681 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-8b57f283-3615-4a7e-a256-9b73e9b18e01 req-22ed9b8c-103b-4786-8ff4-b344800d9677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7e392a-1a02-4faa-a63e-5ac717bd2537", "name": "network-vif-plugged", "status": "completed", "tag": "40c6359b-4d02-4846-9ca2-697e2425c559"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:17:28.860737 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-8b57f283-3615-4a7e-a256-9b73e9b18e01 req-22ed9b8c-103b-4786-8ff4-b344800d9677 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:28.861215 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-8b57f283-3615-4a7e-a256-9b73e9b18e01 req-22ed9b8c-103b-4786-8ff4-b344800d9677 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:28.861704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-8b57f283-3615-4a7e-a256-9b73e9b18e01 req-22ed9b8c-103b-4786-8ff4-b344800d9677 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:28.873828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-8b57f283-3615-4a7e-a256-9b73e9b18e01 req-22ed9b8c-103b-4786-8ff4-b344800d9677 service nova] Creating event network-vif-plugged:40c6359b-4d02-4846-9ca2-697e2425c559 for instance ea7e392a-1a02-4faa-a63e-5ac717bd2537 on hv-cinder-85391 Aug 26 06:17:28.879596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-8b57f283-3615-4a7e-a256-9b73e9b18e01 req-22ed9b8c-103b-4786-8ff4-b344800d9677 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033159 Aug 26 06:17:28.880275 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 74/155] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:17:29.653186 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-daf7cb50-e0b5-4099-b3b8-75ed82241141 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:29.654092 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-daf7cb50-e0b5-4099-b3b8-75ed82241141 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:29.662064 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-daf7cb50-e0b5-4099-b3b8-75ed82241141 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:29.662848 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-daf7cb50-e0b5-4099-b3b8-75ed82241141 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:29.663567 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-daf7cb50-e0b5-4099-b3b8-75ed82241141 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:29.664534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-daf7cb50-e0b5-4099-b3b8-75ed82241141 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:29.665178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-daf7cb50-e0b5-4099-b3b8-75ed82241141 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:29.665794 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-daf7cb50-e0b5-4099-b3b8-75ed82241141 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:29.715101 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9076cc75-da9b-4be2-b324-4753adb4be2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:29.716873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9076cc75-da9b-4be2-b324-4753adb4be2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:29.730389 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9076cc75-da9b-4be2-b324-4753adb4be2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:29.739512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9076cc75-da9b-4be2-b324-4753adb4be2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:29.740997 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9076cc75-da9b-4be2-b324-4753adb4be2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:29.742123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9076cc75-da9b-4be2-b324-4753adb4be2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:29.742670 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9076cc75-da9b-4be2-b324-4753adb4be2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:29.743108 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9076cc75-da9b-4be2-b324-4753adb4be2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:29.855216 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-daf7cb50-e0b5-4099-b3b8-75ed82241141 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:29.862967 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-daf7cb50-e0b5-4099-b3b8-75ed82241141 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.216258 Aug 26 06:17:29.864293 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 82/156] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:29 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:29.933765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9076cc75-da9b-4be2-b324-4753adb4be2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:29.941424 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9076cc75-da9b-4be2-b324-4753adb4be2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1362 microversion: 2.1 time: 0.231853 Aug 26 06:17:29.942009 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 75/157] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:29 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:30.900904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b31cceab-ffed-44a9-86fe-0ded98fd70be tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:30.901550 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b31cceab-ffed-44a9-86fe-0ded98fd70be tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:30.907886 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b31cceab-ffed-44a9-86fe-0ded98fd70be tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:30.909035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b31cceab-ffed-44a9-86fe-0ded98fd70be tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:30.909146 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b31cceab-ffed-44a9-86fe-0ded98fd70be tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:30.909987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b31cceab-ffed-44a9-86fe-0ded98fd70be tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:30.910446 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b31cceab-ffed-44a9-86fe-0ded98fd70be tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:30.910898 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b31cceab-ffed-44a9-86fe-0ded98fd70be tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:30.965020 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-77ab5a1f-0393-40db-8097-9f0334cc76f5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:30.970709 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-77ab5a1f-0393-40db-8097-9f0334cc76f5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:30.982355 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77ab5a1f-0393-40db-8097-9f0334cc76f5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:30.982873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77ab5a1f-0393-40db-8097-9f0334cc76f5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:30.983309 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77ab5a1f-0393-40db-8097-9f0334cc76f5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:30.984086 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77ab5a1f-0393-40db-8097-9f0334cc76f5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:30.984442 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77ab5a1f-0393-40db-8097-9f0334cc76f5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:30.984957 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77ab5a1f-0393-40db-8097-9f0334cc76f5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:31.118287 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b31cceab-ffed-44a9-86fe-0ded98fd70be tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:31.126832 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b31cceab-ffed-44a9-86fe-0ded98fd70be tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.231956 Aug 26 06:17:31.132582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 83/158] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:30 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:31.157691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-77ab5a1f-0393-40db-8097-9f0334cc76f5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:31.166633 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-77ab5a1f-0393-40db-8097-9f0334cc76f5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1547 microversion: 2.1 time: 0.207293 Aug 26 06:17:31.167591 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 76/159] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:30 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1547 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:31.198068 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-083e4361-09f3-4e7d-bd47-2d31ebb2d07f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:31.198606 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-083e4361-09f3-4e7d-bd47-2d31ebb2d07f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:31.205162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-083e4361-09f3-4e7d-bd47-2d31ebb2d07f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:31.205651 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-083e4361-09f3-4e7d-bd47-2d31ebb2d07f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:31.206147 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-083e4361-09f3-4e7d-bd47-2d31ebb2d07f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:31.206934 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-083e4361-09f3-4e7d-bd47-2d31ebb2d07f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:31.207389 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-083e4361-09f3-4e7d-bd47-2d31ebb2d07f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:31.208116 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-083e4361-09f3-4e7d-bd47-2d31ebb2d07f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:31.330636 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-083e4361-09f3-4e7d-bd47-2d31ebb2d07f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137054 Aug 26 06:17:31.331510 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 84/160] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 06:17:31 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:17:32.158061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4dd103a7-8862-48bc-918f-9ad4398deb9d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:32.158814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4dd103a7-8862-48bc-918f-9ad4398deb9d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:32.165782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dd103a7-8862-48bc-918f-9ad4398deb9d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:32.166344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dd103a7-8862-48bc-918f-9ad4398deb9d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:32.166815 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dd103a7-8862-48bc-918f-9ad4398deb9d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:32.167775 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dd103a7-8862-48bc-918f-9ad4398deb9d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:32.168222 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dd103a7-8862-48bc-918f-9ad4398deb9d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:32.168643 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dd103a7-8862-48bc-918f-9ad4398deb9d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:32.314571 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4dd103a7-8862-48bc-918f-9ad4398deb9d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:32.323874 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4dd103a7-8862-48bc-918f-9ad4398deb9d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1322 microversion: 2.1 time: 0.175751 Aug 26 06:17:32.324511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 77/161] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:32 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:32.554569 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4a3a696c-b8fc-4682-901f-46eb1cb3259f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c27b4f8-62cf-41b6-8ad7-890cbc21974f"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:17:32.557045 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4a3a696c-b8fc-4682-901f-46eb1cb3259f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:32.563123 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a3a696c-b8fc-4682-901f-46eb1cb3259f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:32.563607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a3a696c-b8fc-4682-901f-46eb1cb3259f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:32.564038 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a3a696c-b8fc-4682-901f-46eb1cb3259f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:32.564723 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a3a696c-b8fc-4682-901f-46eb1cb3259f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:32.565442 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a3a696c-b8fc-4682-901f-46eb1cb3259f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:32.565870 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a3a696c-b8fc-4682-901f-46eb1cb3259f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:32.967932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-5631f44c-40d3-4dfe-a827-abbcb3d21dd2 req-371d0086-ca11-48b6-9ac3-37a5869066d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0dda9da-e7bd-4a7d-b807-a2074ccbe208", "tag": "eb6ebb39-9a85-4eaa-88a1-9d3aff9f8785"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:17:32.978571 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-5631f44c-40d3-4dfe-a827-abbcb3d21dd2 req-371d0086-ca11-48b6-9ac3-37a5869066d1 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:32.979107 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-5631f44c-40d3-4dfe-a827-abbcb3d21dd2 req-371d0086-ca11-48b6-9ac3-37a5869066d1 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:32.979538 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-5631f44c-40d3-4dfe-a827-abbcb3d21dd2 req-371d0086-ca11-48b6-9ac3-37a5869066d1 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:32.993547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-5631f44c-40d3-4dfe-a827-abbcb3d21dd2 req-371d0086-ca11-48b6-9ac3-37a5869066d1 service nova] Creating event network-changed:eb6ebb39-9a85-4eaa-88a1-9d3aff9f8785 for instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 on hv-cinder-85391 Aug 26 06:17:32.999598 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-5631f44c-40d3-4dfe-a827-abbcb3d21dd2 req-371d0086-ca11-48b6-9ac3-37a5869066d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034865 Aug 26 06:17:33.000297 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 78/162] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:17:33.348056 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-15628c9c-7e13-46ff-bddd-795067188718 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:33.349363 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-15628c9c-7e13-46ff-bddd-795067188718 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:33.360916 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15628c9c-7e13-46ff-bddd-795067188718 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:33.361579 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15628c9c-7e13-46ff-bddd-795067188718 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:33.363683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15628c9c-7e13-46ff-bddd-795067188718 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:33.363683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15628c9c-7e13-46ff-bddd-795067188718 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:33.363683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15628c9c-7e13-46ff-bddd-795067188718 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:33.363928 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15628c9c-7e13-46ff-bddd-795067188718 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:33.624450 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-15628c9c-7e13-46ff-bddd-795067188718 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:33.635760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-15628c9c-7e13-46ff-bddd-795067188718 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1516 microversion: 2.1 time: 0.293200 Aug 26 06:17:33.637444 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 79/163] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:33 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1516 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:33.673083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bfd59f1b-ab87-4295-8769-d22f1643cb48 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:17:33.676282 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-bfd59f1b-ab87-4295-8769-d22f1643cb48 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:33.683149 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bfd59f1b-ab87-4295-8769-d22f1643cb48 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:33.683697 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bfd59f1b-ab87-4295-8769-d22f1643cb48 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:33.684179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bfd59f1b-ab87-4295-8769-d22f1643cb48 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:33.684760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bfd59f1b-ab87-4295-8769-d22f1643cb48 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:33.685224 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bfd59f1b-ab87-4295-8769-d22f1643cb48 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:33.685622 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bfd59f1b-ab87-4295-8769-d22f1643cb48 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:33.759955 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-bfd59f1b-ab87-4295-8769-d22f1643cb48 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lazy-loading 'flavor' on Instance uuid ea7e392a-1a02-4faa-a63e-5ac717bd2537 {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:17:33.790538 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=100 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:34.251004 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bfd59f1b-ab87-4295-8769-d22f1643cb48 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "POST /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537/action" status: 200 len: 32 microversion: 2.1 time: 0.586676 Aug 26 06:17:34.251906 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 80/164] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:17:33 2022] POST /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537/action => generated 32 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 06:17:34.280730 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-fb6d41c3-3005-437c-b9a3-630415d4ecb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:34.284785 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-fb6d41c3-3005-437c-b9a3-630415d4ecb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:34.294495 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb6d41c3-3005-437c-b9a3-630415d4ecb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:34.301078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb6d41c3-3005-437c-b9a3-630415d4ecb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:34.301078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb6d41c3-3005-437c-b9a3-630415d4ecb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:34.301078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb6d41c3-3005-437c-b9a3-630415d4ecb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:34.301078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb6d41c3-3005-437c-b9a3-630415d4ecb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:34.301439 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb6d41c3-3005-437c-b9a3-630415d4ecb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:34.507325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fb6d41c3-3005-437c-b9a3-630415d4ecb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:34.517400 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-fb6d41c3-3005-437c-b9a3-630415d4ecb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.248258 Aug 26 06:17:34.530922 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 81/165] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:34 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:35.217580 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4a3a696c-b8fc-4682-901f-46eb1cb3259f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "POST /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.667641 Aug 26 06:17:35.218886 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 85/166] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:17:32 2022] POST /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f/os-volume_attachments => generated 194 bytes in 2670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:17:35.542677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7c2ba761-e383-4130-a434-461afd2e5f51 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:35.549221 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7c2ba761-e383-4130-a434-461afd2e5f51 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:35.556862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c2ba761-e383-4130-a434-461afd2e5f51 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:35.557430 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c2ba761-e383-4130-a434-461afd2e5f51 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:35.558220 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c2ba761-e383-4130-a434-461afd2e5f51 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:35.567647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c2ba761-e383-4130-a434-461afd2e5f51 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:35.567647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c2ba761-e383-4130-a434-461afd2e5f51 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:35.567647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c2ba761-e383-4130-a434-461afd2e5f51 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:35.748269 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7c2ba761-e383-4130-a434-461afd2e5f51 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:35.763468 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7c2ba761-e383-4130-a434-461afd2e5f51 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.226079 Aug 26 06:17:35.764044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 82/167] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:35 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:36.785951 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0c3d3310-7e83-4c47-bf11-c872028277b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:36.786658 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0c3d3310-7e83-4c47-bf11-c872028277b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:36.793677 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c3d3310-7e83-4c47-bf11-c872028277b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:36.794155 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c3d3310-7e83-4c47-bf11-c872028277b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:36.795310 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c3d3310-7e83-4c47-bf11-c872028277b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:36.795435 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c3d3310-7e83-4c47-bf11-c872028277b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:36.795798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c3d3310-7e83-4c47-bf11-c872028277b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:36.796221 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c3d3310-7e83-4c47-bf11-c872028277b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:36.942511 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0c3d3310-7e83-4c47-bf11-c872028277b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:36.950978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0c3d3310-7e83-4c47-bf11-c872028277b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.170171 Aug 26 06:17:36.963052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 86/168] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:36 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:37.971861 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4d621e09-3ab3-4ac9-aec6-07a542a1021f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:37.972540 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4d621e09-3ab3-4ac9-aec6-07a542a1021f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:37.979276 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d621e09-3ab3-4ac9-aec6-07a542a1021f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:37.979753 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d621e09-3ab3-4ac9-aec6-07a542a1021f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:37.980185 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d621e09-3ab3-4ac9-aec6-07a542a1021f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:37.980875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d621e09-3ab3-4ac9-aec6-07a542a1021f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:37.981327 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d621e09-3ab3-4ac9-aec6-07a542a1021f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:37.981750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d621e09-3ab3-4ac9-aec6-07a542a1021f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:38.294161 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4d621e09-3ab3-4ac9-aec6-07a542a1021f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:38.302357 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4d621e09-3ab3-4ac9-aec6-07a542a1021f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.334475 Aug 26 06:17:38.303129 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 83/169] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:37 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:39.327745 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a461b23a-86ab-4b72-a07e-c262ba09a166 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:39.329362 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a461b23a-86ab-4b72-a07e-c262ba09a166 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:39.332027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=72 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:39.338176 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a461b23a-86ab-4b72-a07e-c262ba09a166 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:39.338707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a461b23a-86ab-4b72-a07e-c262ba09a166 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:39.339164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a461b23a-86ab-4b72-a07e-c262ba09a166 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:39.339907 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a461b23a-86ab-4b72-a07e-c262ba09a166 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:39.340360 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a461b23a-86ab-4b72-a07e-c262ba09a166 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:39.340790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a461b23a-86ab-4b72-a07e-c262ba09a166 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:39.495450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a461b23a-86ab-4b72-a07e-c262ba09a166 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:39.505254 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a461b23a-86ab-4b72-a07e-c262ba09a166 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.184178 Aug 26 06:17:39.506802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 87/170] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:39 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:40.534189 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3291865c-a37e-4cf2-9beb-8182e857ab86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:40.535611 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3291865c-a37e-4cf2-9beb-8182e857ab86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:40.549293 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3291865c-a37e-4cf2-9beb-8182e857ab86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:40.550372 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3291865c-a37e-4cf2-9beb-8182e857ab86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:40.551158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3291865c-a37e-4cf2-9beb-8182e857ab86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:40.552445 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3291865c-a37e-4cf2-9beb-8182e857ab86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:40.554971 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3291865c-a37e-4cf2-9beb-8182e857ab86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:40.555674 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3291865c-a37e-4cf2-9beb-8182e857ab86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:40.715054 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3291865c-a37e-4cf2-9beb-8182e857ab86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:40.724570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3291865c-a37e-4cf2-9beb-8182e857ab86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.194532 Aug 26 06:17:40.725883 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 84/171] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:40 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:41.754348 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c6a1a32d-937a-4328-b191-3df0cccfb871 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:41.760270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c6a1a32d-937a-4328-b191-3df0cccfb871 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:41.767401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6a1a32d-937a-4328-b191-3df0cccfb871 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:41.767891 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6a1a32d-937a-4328-b191-3df0cccfb871 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:41.768323 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6a1a32d-937a-4328-b191-3df0cccfb871 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:41.769231 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6a1a32d-937a-4328-b191-3df0cccfb871 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:41.769776 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6a1a32d-937a-4328-b191-3df0cccfb871 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:41.770208 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6a1a32d-937a-4328-b191-3df0cccfb871 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:41.933589 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c6a1a32d-937a-4328-b191-3df0cccfb871 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:41.941702 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c6a1a32d-937a-4328-b191-3df0cccfb871 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.192513 Aug 26 06:17:41.956776 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 88/172] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:41 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:42.963749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-41c6fc11-d8af-41ca-b910-4eb9eecbd306 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:42.964488 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-41c6fc11-d8af-41ca-b910-4eb9eecbd306 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:42.980585 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=78 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:42.990091 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41c6fc11-d8af-41ca-b910-4eb9eecbd306 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:42.993643 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41c6fc11-d8af-41ca-b910-4eb9eecbd306 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:42.994310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41c6fc11-d8af-41ca-b910-4eb9eecbd306 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:42.996836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41c6fc11-d8af-41ca-b910-4eb9eecbd306 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:42.997603 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41c6fc11-d8af-41ca-b910-4eb9eecbd306 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:42.999414 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41c6fc11-d8af-41ca-b910-4eb9eecbd306 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:43.178290 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-41c6fc11-d8af-41ca-b910-4eb9eecbd306 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:43.194331 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-41c6fc11-d8af-41ca-b910-4eb9eecbd306 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.234741 Aug 26 06:17:43.195494 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 85/173] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:42 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:44.222036 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e2aad572-138f-4f40-8f23-3c9abd8d2a8d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:44.222775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e2aad572-138f-4f40-8f23-3c9abd8d2a8d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:44.234687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2aad572-138f-4f40-8f23-3c9abd8d2a8d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:44.234687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2aad572-138f-4f40-8f23-3c9abd8d2a8d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:44.234687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2aad572-138f-4f40-8f23-3c9abd8d2a8d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:44.234687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2aad572-138f-4f40-8f23-3c9abd8d2a8d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:44.235003 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2aad572-138f-4f40-8f23-3c9abd8d2a8d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:44.235226 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2aad572-138f-4f40-8f23-3c9abd8d2a8d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:44.441664 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e2aad572-138f-4f40-8f23-3c9abd8d2a8d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:44.450325 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e2aad572-138f-4f40-8f23-3c9abd8d2a8d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.232160 Aug 26 06:17:44.450880 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 89/174] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:44 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:45.473511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8c0be23d-5fdd-4f78-ba1f-5b90fdc89782 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:45.474394 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8c0be23d-5fdd-4f78-ba1f-5b90fdc89782 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:45.481921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c0be23d-5fdd-4f78-ba1f-5b90fdc89782 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:45.482685 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c0be23d-5fdd-4f78-ba1f-5b90fdc89782 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:45.483243 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c0be23d-5fdd-4f78-ba1f-5b90fdc89782 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:45.484097 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c0be23d-5fdd-4f78-ba1f-5b90fdc89782 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:45.487482 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c0be23d-5fdd-4f78-ba1f-5b90fdc89782 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:45.487482 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c0be23d-5fdd-4f78-ba1f-5b90fdc89782 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:45.656859 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8c0be23d-5fdd-4f78-ba1f-5b90fdc89782 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:45.667330 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8c0be23d-5fdd-4f78-ba1f-5b90fdc89782 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.197235 Aug 26 06:17:45.668404 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 86/175] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:45 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:46.709597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4f0c0d65-0ed3-4b1c-b596-590b6cd97f5b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:46.711704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4f0c0d65-0ed3-4b1c-b596-590b6cd97f5b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:46.735244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4f0c0d65-0ed3-4b1c-b596-590b6cd97f5b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:46.742376 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4f0c0d65-0ed3-4b1c-b596-590b6cd97f5b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:46.746345 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4f0c0d65-0ed3-4b1c-b596-590b6cd97f5b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:46.747788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4f0c0d65-0ed3-4b1c-b596-590b6cd97f5b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:46.748479 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4f0c0d65-0ed3-4b1c-b596-590b6cd97f5b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:46.749346 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4f0c0d65-0ed3-4b1c-b596-590b6cd97f5b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:46.926869 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4f0c0d65-0ed3-4b1c-b596-590b6cd97f5b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:46.936172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4f0c0d65-0ed3-4b1c-b596-590b6cd97f5b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.243453 Aug 26 06:17:46.936785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 90/176] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:46 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:47.959598 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7e42c359-d7d8-4dc1-9106-4712675a3813 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:47.960864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7e42c359-d7d8-4dc1-9106-4712675a3813 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:47.967921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7e42c359-d7d8-4dc1-9106-4712675a3813 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:47.968640 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7e42c359-d7d8-4dc1-9106-4712675a3813 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:47.969243 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7e42c359-d7d8-4dc1-9106-4712675a3813 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:47.970100 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7e42c359-d7d8-4dc1-9106-4712675a3813 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:47.970569 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7e42c359-d7d8-4dc1-9106-4712675a3813 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:47.971020 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7e42c359-d7d8-4dc1-9106-4712675a3813 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:48.113708 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-24421bcb-63fb-4b9e-b409-c29bbcba56dc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:48.114581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-24421bcb-63fb-4b9e-b409-c29bbcba56dc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:48.121956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24421bcb-63fb-4b9e-b409-c29bbcba56dc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:48.124095 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24421bcb-63fb-4b9e-b409-c29bbcba56dc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:48.124095 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24421bcb-63fb-4b9e-b409-c29bbcba56dc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:48.124095 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24421bcb-63fb-4b9e-b409-c29bbcba56dc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:48.124355 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24421bcb-63fb-4b9e-b409-c29bbcba56dc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:48.124589 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24421bcb-63fb-4b9e-b409-c29bbcba56dc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:48.167014 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-24421bcb-63fb-4b9e-b409-c29bbcba56dc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:17:48.169899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7e42c359-d7d8-4dc1-9106-4712675a3813 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:48.181077 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7e42c359-d7d8-4dc1-9106-4712675a3813 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.226983 Aug 26 06:17:48.181655 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 87/177] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:47 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:48.637977 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-24421bcb-63fb-4b9e-b409-c29bbcba56dc tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "DELETE /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 204 len: 0 microversion: 2.1 time: 0.527547 Aug 26 06:17:48.640228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 91/178] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:17:48 2022] DELETE /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 06:17:48.648508 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-1577dc92-dbef-4010-9ff2-27b1827811ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:48.649514 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1577dc92-dbef-4010-9ff2-27b1827811ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:48.655987 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1577dc92-dbef-4010-9ff2-27b1827811ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:48.656470 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1577dc92-dbef-4010-9ff2-27b1827811ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:48.657019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1577dc92-dbef-4010-9ff2-27b1827811ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:48.657691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1577dc92-dbef-4010-9ff2-27b1827811ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:48.659413 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1577dc92-dbef-4010-9ff2-27b1827811ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:48.659413 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1577dc92-dbef-4010-9ff2-27b1827811ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:48.808777 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1577dc92-dbef-4010-9ff2-27b1827811ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:48.817162 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-1577dc92-dbef-4010-9ff2-27b1827811ba tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1554 microversion: 2.1 time: 0.174234 Aug 26 06:17:48.817720 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 88/179] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:48 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:49.209914 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2d3e9a93-394d-48b8-8b31-934e2d06a5c3 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:49.209914 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2d3e9a93-394d-48b8-8b31-934e2d06a5c3 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:49.215500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2d3e9a93-394d-48b8-8b31-934e2d06a5c3 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:49.216019 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2d3e9a93-394d-48b8-8b31-934e2d06a5c3 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:49.216458 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2d3e9a93-394d-48b8-8b31-934e2d06a5c3 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:49.217230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2d3e9a93-394d-48b8-8b31-934e2d06a5c3 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:49.217688 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2d3e9a93-394d-48b8-8b31-934e2d06a5c3 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:49.218125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2d3e9a93-394d-48b8-8b31-934e2d06a5c3 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:49.373332 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2d3e9a93-394d-48b8-8b31-934e2d06a5c3 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:49.382650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2d3e9a93-394d-48b8-8b31-934e2d06a5c3 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.182887 Aug 26 06:17:49.383350 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 92/180] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:49 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:49.839014 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-96f2898e-b479-4bc0-83b4-66ecbb09830d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:49.839618 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-96f2898e-b479-4bc0-83b4-66ecbb09830d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:49.845541 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-96f2898e-b479-4bc0-83b4-66ecbb09830d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:49.846013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-96f2898e-b479-4bc0-83b4-66ecbb09830d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:49.846440 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-96f2898e-b479-4bc0-83b4-66ecbb09830d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:49.847147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-96f2898e-b479-4bc0-83b4-66ecbb09830d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:49.847586 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-96f2898e-b479-4bc0-83b4-66ecbb09830d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:49.848004 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-96f2898e-b479-4bc0-83b4-66ecbb09830d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:50.014284 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-96f2898e-b479-4bc0-83b4-66ecbb09830d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:50.023181 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-96f2898e-b479-4bc0-83b4-66ecbb09830d tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1554 microversion: 2.1 time: 0.188011 Aug 26 06:17:50.023935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 89/181] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:49 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:50.404115 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-17669691-33f2-4c4b-9f19-5695a1692806 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:50.404753 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-17669691-33f2-4c4b-9f19-5695a1692806 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:50.415829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-17669691-33f2-4c4b-9f19-5695a1692806 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:50.415829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-17669691-33f2-4c4b-9f19-5695a1692806 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:50.415829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-17669691-33f2-4c4b-9f19-5695a1692806 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:50.415829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-17669691-33f2-4c4b-9f19-5695a1692806 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:50.417741 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-17669691-33f2-4c4b-9f19-5695a1692806 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:50.417741 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-17669691-33f2-4c4b-9f19-5695a1692806 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:50.590827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-17669691-33f2-4c4b-9f19-5695a1692806 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:50.598671 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-17669691-33f2-4c4b-9f19-5695a1692806 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.198393 Aug 26 06:17:50.599374 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 93/182] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:50 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:51.045230 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-427a5c12-80d5-474e-8544-ff6d00214a05 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:51.046913 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-427a5c12-80d5-474e-8544-ff6d00214a05 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:51.055541 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-427a5c12-80d5-474e-8544-ff6d00214a05 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:51.056209 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-427a5c12-80d5-474e-8544-ff6d00214a05 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:51.056797 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-427a5c12-80d5-474e-8544-ff6d00214a05 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:51.057865 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-427a5c12-80d5-474e-8544-ff6d00214a05 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:51.058487 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-427a5c12-80d5-474e-8544-ff6d00214a05 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:51.059118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-427a5c12-80d5-474e-8544-ff6d00214a05 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:51.307818 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-427a5c12-80d5-474e-8544-ff6d00214a05 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:51.316188 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-427a5c12-80d5-474e-8544-ff6d00214a05 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1554 microversion: 2.1 time: 0.275525 Aug 26 06:17:51.316763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 90/183] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:51 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1554 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:51.624119 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-00e42bf5-5488-4389-9ae0-745657d006eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:51.626877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-00e42bf5-5488-4389-9ae0-745657d006eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:51.634993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e42bf5-5488-4389-9ae0-745657d006eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:51.635889 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e42bf5-5488-4389-9ae0-745657d006eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:51.636358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e42bf5-5488-4389-9ae0-745657d006eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:51.637125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e42bf5-5488-4389-9ae0-745657d006eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:51.637823 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e42bf5-5488-4389-9ae0-745657d006eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:51.638339 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e42bf5-5488-4389-9ae0-745657d006eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:51.665322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:51.933969 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-01345efc-7e71-4f83-95d1-490e932859b4 req-67de1dd0-438c-4a31-ac5e-57f097bd020c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012ac1bd-a390-4776-841b-f11f736a3d9f", "name": "network-vif-deleted", "tag": "e7a88b0e-f6e1-473e-9018-7ee3f4181af9"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:17:51.949669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-00e42bf5-5488-4389-9ae0-745657d006eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:51.963635 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-01345efc-7e71-4f83-95d1-490e932859b4 req-67de1dd0-438c-4a31-ac5e-57f097bd020c service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:51.963635 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-01345efc-7e71-4f83-95d1-490e932859b4 req-67de1dd0-438c-4a31-ac5e-57f097bd020c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:51.963635 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-01345efc-7e71-4f83-95d1-490e932859b4 req-67de1dd0-438c-4a31-ac5e-57f097bd020c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:51.966746 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-00e42bf5-5488-4389-9ae0-745657d006eb tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.349003 Aug 26 06:17:51.968381 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 94/184] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:51 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:51.992662 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-01345efc-7e71-4f83-95d1-490e932859b4 req-67de1dd0-438c-4a31-ac5e-57f097bd020c service nova] Creating event network-vif-deleted:e7a88b0e-f6e1-473e-9018-7ee3f4181af9 for instance 012ac1bd-a390-4776-841b-f11f736a3d9f on hv-cinder-85391 Aug 26 06:17:52.002889 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-01345efc-7e71-4f83-95d1-490e932859b4 req-67de1dd0-438c-4a31-ac5e-57f097bd020c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071836 Aug 26 06:17:52.003824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 91/185] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:17:52.369569 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-31767fd6-8f0d-4ecd-8df6-b6be4da8cda9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:52.369569 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-31767fd6-8f0d-4ecd-8df6-b6be4da8cda9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:52.369569 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-31767fd6-8f0d-4ecd-8df6-b6be4da8cda9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:52.369569 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-31767fd6-8f0d-4ecd-8df6-b6be4da8cda9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:52.370146 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-31767fd6-8f0d-4ecd-8df6-b6be4da8cda9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:52.370146 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-31767fd6-8f0d-4ecd-8df6-b6be4da8cda9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:52.370146 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-31767fd6-8f0d-4ecd-8df6-b6be4da8cda9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:52.370146 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-31767fd6-8f0d-4ecd-8df6-b6be4da8cda9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:52.463720 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-31767fd6-8f0d-4ecd-8df6-b6be4da8cda9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:52.474565 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-31767fd6-8f0d-4ecd-8df6-b6be4da8cda9 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1346 microversion: 2.1 time: 0.134981 Aug 26 06:17:52.475929 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 95/186] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:52 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1346 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:52.989799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-015076d3-5973-4310-9476-5d7c239008cc tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:52.990776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-015076d3-5973-4310-9476-5d7c239008cc tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:52.997035 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-015076d3-5973-4310-9476-5d7c239008cc tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:52.997591 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-015076d3-5973-4310-9476-5d7c239008cc tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:52.998089 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-015076d3-5973-4310-9476-5d7c239008cc tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:52.998870 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-015076d3-5973-4310-9476-5d7c239008cc tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:52.999404 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-015076d3-5973-4310-9476-5d7c239008cc tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:52.999909 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-015076d3-5973-4310-9476-5d7c239008cc tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:53.136265 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-015076d3-5973-4310-9476-5d7c239008cc tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:53.145680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-015076d3-5973-4310-9476-5d7c239008cc tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.159774 Aug 26 06:17:53.147681 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 92/187] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:52 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:53.504926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:53.506337 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:53.522864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:53.523944 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:53.524750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:53.526441 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:53.528253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:53.528669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:53.677679 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:53.678292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:53.678992 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:53.679470 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lazy-loading 'fault' on Instance uuid 012ac1bd-a390-4776-841b-f11f736a3d9f {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:17:53.757000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7b7684d766542b097b88d642114023b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6936f23aa446008e8119807ec8724d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:53.768350 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3190e9fc-d3dd-435f-9803-e71b40c64ac6 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 200 len: 1351 microversion: 2.1 time: 0.273141 Aug 26 06:17:53.771796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 96/188] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:53 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 1351 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:54.170341 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e872710a-46d8-4f14-8d16-99afab342657 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:54.171213 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e872710a-46d8-4f14-8d16-99afab342657 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:54.178340 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e872710a-46d8-4f14-8d16-99afab342657 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:54.179416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e872710a-46d8-4f14-8d16-99afab342657 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:54.179916 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e872710a-46d8-4f14-8d16-99afab342657 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:54.180886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e872710a-46d8-4f14-8d16-99afab342657 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:54.181335 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e872710a-46d8-4f14-8d16-99afab342657 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:54.181802 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e872710a-46d8-4f14-8d16-99afab342657 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:54.406449 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e872710a-46d8-4f14-8d16-99afab342657 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:54.415530 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e872710a-46d8-4f14-8d16-99afab342657 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.249792 Aug 26 06:17:54.416235 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 93/189] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:54 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:54.794459 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:54.795070 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:54.801327 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:54.801983 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:54.802420 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:54.803322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:54.803779 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:54.804345 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:54.818586 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] HTTP exception thrown: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Request method failure captured: Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f HTTP/1.1 Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGVGugbbVg7Kw7mkhIqprP_UWrnF3-ywQtJoKE-Vw22ydfEhTAC5RU0ipjH3ZtfZ_5o3VCN_40G8wCTSfT89QzWoYLtlt9vWk0CdN5tJBogHrheo8u4qHesGu12gdspJO1s394WBvxLOfmEYuCeasjGhcVxHz7-liDU3d0ZI4SaItGs Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: bf6936f23aa446008e8119807ec8724d Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:17:54.823368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bf6936f23aa446008e8119807ec8724d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: bf6936f23aa446008e8119807ec8724d Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-DeleteServersTestJSON-50482851-project Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: a7b7684d766542b097b88d642114023b Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-DeleteServersTestJSON-50482851-project Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:54.824840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '012ac1bd-a390-4776-841b-f11f736a3d9f'} Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:17:54.825648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:54.826980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:54.828101 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Returning 404 to user: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:17:54.828101 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ce335b60-78ff-447d-8e68-04accf4dc226 tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 404 len: 111 microversion: 2.1 time: 0.035165 Aug 26 06:17:54.828101 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 97/190] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:54 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:17:54.956766 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:54.958907 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:54.964928 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:54.977323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:54.977323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:54.977323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:54.977323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:54.977841 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:54.981508 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] HTTP exception thrown: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Request method failure captured: Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f/os-volume_attachments HTTP/1.1 Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGVGugbbVg7Kw7mkhIqprP_UWrnF3-ywQtJoKE-Vw22ydfEhTAC5RU0ipjH3ZtfZ_5o3VCN_40G8wCTSfT89QzWoYLtlt9vWk0CdN5tJBogHrheo8u4qHesGu12gdspJO1s394WBvxLOfmEYuCeasjGhcVxHz7-liDU3d0ZI4SaItGs Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: bf6936f23aa446008e8119807ec8724d Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:17:54.987549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bf6936f23aa446008e8119807ec8724d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: bf6936f23aa446008e8119807ec8724d Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-DeleteServersTestJSON-50482851-project Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: a7b7684d766542b097b88d642114023b Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-DeleteServersTestJSON-50482851-project Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:54.988975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'server_id': '012ac1bd-a390-4776-841b-f11f736a3d9f'} Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:17:54.989735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:54.992326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:17:54.993681 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Returning 404 to user: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:17:54.993681 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-16d1f85d-3e47-4e93-8009-48a49134ae8c tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036529 Aug 26 06:17:54.993681 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 94/191] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:17:54 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:17:55.445001 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-497915fb-49b6-4a19-9295-a84e2f9ed91e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:55.445662 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-497915fb-49b6-4a19-9295-a84e2f9ed91e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:55.453953 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-497915fb-49b6-4a19-9295-a84e2f9ed91e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:55.454517 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-497915fb-49b6-4a19-9295-a84e2f9ed91e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:55.454771 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-497915fb-49b6-4a19-9295-a84e2f9ed91e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:55.455790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-497915fb-49b6-4a19-9295-a84e2f9ed91e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:55.456253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-497915fb-49b6-4a19-9295-a84e2f9ed91e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:55.457360 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-497915fb-49b6-4a19-9295-a84e2f9ed91e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:55.636381 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-497915fb-49b6-4a19-9295-a84e2f9ed91e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:55.644619 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-497915fb-49b6-4a19-9295-a84e2f9ed91e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.207050 Aug 26 06:17:55.648150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 98/192] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:55 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:17:56.676672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ed6e39b7-a0f3-43e1-b878-804892717c9f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:56.677439 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ed6e39b7-a0f3-43e1-b878-804892717c9f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:56.685058 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed6e39b7-a0f3-43e1-b878-804892717c9f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:56.685546 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed6e39b7-a0f3-43e1-b878-804892717c9f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:56.685980 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed6e39b7-a0f3-43e1-b878-804892717c9f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:56.686713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed6e39b7-a0f3-43e1-b878-804892717c9f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:56.687168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed6e39b7-a0f3-43e1-b878-804892717c9f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:56.687610 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed6e39b7-a0f3-43e1-b878-804892717c9f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:56.742808 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:56.743659 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:56.754976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:56.755684 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:56.759149 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:56.759149 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:56.759149 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:56.759614 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:56.783370 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] HTTP exception thrown: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Request method failure captured: Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: DELETE /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f HTTP/1.1 Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGVGugbbVg7Kw7mkhIqprP_UWrnF3-ywQtJoKE-Vw22ydfEhTAC5RU0ipjH3ZtfZ_5o3VCN_40G8wCTSfT89QzWoYLtlt9vWk0CdN5tJBogHrheo8u4qHesGu12gdspJO1s394WBvxLOfmEYuCeasjGhcVxHz7-liDU3d0ZI4SaItGs Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: bf6936f23aa446008e8119807ec8724d Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:17:56.786333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bf6936f23aa446008e8119807ec8724d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: bf6936f23aa446008e8119807ec8724d Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-DeleteServersTestJSON-50482851-project Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: a7b7684d766542b097b88d642114023b Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-DeleteServersTestJSON-50482851-project Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:56.789424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '012ac1bd-a390-4776-841b-f11f736a3d9f'} Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:17:56.790879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:56.793710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:56.796413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Returning 404 to user: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:17:56.796413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-27969402-ef04-4a29-9910-97e6ff0e7afe tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "DELETE /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 404 len: 111 microversion: 2.1 time: 0.054088 Aug 26 06:17:56.796413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 99/193] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:17:56 2022] DELETE /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:17:56.802593 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:56.803509 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] [instance: 012ac1bd-a390-4776-841b-f11f736a3d9f] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:56.812236 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:56.813022 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:56.813635 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:56.814386 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:56.815066 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:56.816213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:56.842175 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] HTTP exception thrown: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Request method failure captured: Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f HTTP/1.1 Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGVGugbbVg7Kw7mkhIqprP_UWrnF3-ywQtJoKE-Vw22ydfEhTAC5RU0ipjH3ZtfZ_5o3VCN_40G8wCTSfT89QzWoYLtlt9vWk0CdN5tJBogHrheo8u4qHesGu12gdspJO1s394WBvxLOfmEYuCeasjGhcVxHz7-liDU3d0ZI4SaItGs Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: bf6936f23aa446008e8119807ec8724d Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:17:56.845284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/bf6936f23aa446008e8119807ec8724d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_bf6936f23aa446008e8119807ec8724d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: bf6936f23aa446008e8119807ec8724d Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-DeleteServersTestJSON-50482851 Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-DeleteServersTestJSON-50482851-project Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: a7b7684d766542b097b88d642114023b Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-DeleteServersTestJSON-50482851-project Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:56.846697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '012ac1bd-a390-4776-841b-f11f736a3d9f'} Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:17:56.847475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. Aug 26 06:17:56.848669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:17:56.849815 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] Returning 404 to user: Instance 012ac1bd-a390-4776-841b-f11f736a3d9f could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:17:56.849815 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5f74817a-2865-49c1-a9be-8720994e4e2f tempest-DeleteServersTestJSON-50482851 tempest-DeleteServersTestJSON-50482851-project] 10.222.0.40 "GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f" status: 404 len: 111 microversion: 2.1 time: 0.049817 Aug 26 06:17:56.849815 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 100/194] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:56 2022] GET /compute/v2.1/servers/012ac1bd-a390-4776-841b-f11f736a3d9f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:17:56.870824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ed6e39b7-a0f3-43e1-b878-804892717c9f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:56.884282 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ed6e39b7-a0f3-43e1-b878-804892717c9f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.211463 Aug 26 06:17:56.885305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 95/195] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:56 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:57.916505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-78a58f0d-a6e2-43cd-bb2d-4f644606a7da tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:57.916505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-78a58f0d-a6e2-43cd-bb2d-4f644606a7da tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:57.924332 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78a58f0d-a6e2-43cd-bb2d-4f644606a7da tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:57.925706 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78a58f0d-a6e2-43cd-bb2d-4f644606a7da tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:57.927081 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78a58f0d-a6e2-43cd-bb2d-4f644606a7da tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:57.929155 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78a58f0d-a6e2-43cd-bb2d-4f644606a7da tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:57.930749 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78a58f0d-a6e2-43cd-bb2d-4f644606a7da tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:57.932038 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78a58f0d-a6e2-43cd-bb2d-4f644606a7da tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:58.305702 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-78a58f0d-a6e2-43cd-bb2d-4f644606a7da tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:58.319326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-78a58f0d-a6e2-43cd-bb2d-4f644606a7da tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.413224 Aug 26 06:17:58.329212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 101/196] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:57 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:17:59.387310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-82688b17-dc89-42e9-acf7-1435281dca60 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:17:59.395721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-82688b17-dc89-42e9-acf7-1435281dca60 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:17:59.433321 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82688b17-dc89-42e9-acf7-1435281dca60 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:59.435335 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82688b17-dc89-42e9-acf7-1435281dca60 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:59.435805 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82688b17-dc89-42e9-acf7-1435281dca60 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:59.440072 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82688b17-dc89-42e9-acf7-1435281dca60 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:17:59.440900 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82688b17-dc89-42e9-acf7-1435281dca60 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:17:59.443652 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82688b17-dc89-42e9-acf7-1435281dca60 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:17:59.629382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-82688b17-dc89-42e9-acf7-1435281dca60 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:17:59.632602 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:17:59.639141 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-82688b17-dc89-42e9-acf7-1435281dca60 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.281310 Aug 26 06:17:59.639709 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 96/197] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:17:59 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:00.682974 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-117e603a-1c62-4a74-b382-0fc17c3e04ec tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:00.683744 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-117e603a-1c62-4a74-b382-0fc17c3e04ec tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:00.692002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-117e603a-1c62-4a74-b382-0fc17c3e04ec tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:00.692609 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-117e603a-1c62-4a74-b382-0fc17c3e04ec tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:00.693054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-117e603a-1c62-4a74-b382-0fc17c3e04ec tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:00.694348 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-117e603a-1c62-4a74-b382-0fc17c3e04ec tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:00.694956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-117e603a-1c62-4a74-b382-0fc17c3e04ec tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:00.695660 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-117e603a-1c62-4a74-b382-0fc17c3e04ec tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:01.106110 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-117e603a-1c62-4a74-b382-0fc17c3e04ec tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:01.120162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-117e603a-1c62-4a74-b382-0fc17c3e04ec tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.449506 Aug 26 06:18:01.120844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 102/198] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:00 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:02.147111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7a256310-358a-4c92-8399-f6ecb3f74b55 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:02.148410 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7a256310-358a-4c92-8399-f6ecb3f74b55 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:02.171541 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a256310-358a-4c92-8399-f6ecb3f74b55 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:02.172388 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a256310-358a-4c92-8399-f6ecb3f74b55 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:02.173165 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a256310-358a-4c92-8399-f6ecb3f74b55 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:02.175653 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a256310-358a-4c92-8399-f6ecb3f74b55 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:02.176482 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a256310-358a-4c92-8399-f6ecb3f74b55 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:02.177482 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a256310-358a-4c92-8399-f6ecb3f74b55 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:02.414793 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7a256310-358a-4c92-8399-f6ecb3f74b55 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:02.426376 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7a256310-358a-4c92-8399-f6ecb3f74b55 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.287559 Aug 26 06:18:02.440961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 97/199] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:02 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:03.455419 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-22baca0f-d9e7-423a-bb8a-7df576f7343a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:03.457483 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-22baca0f-d9e7-423a-bb8a-7df576f7343a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:03.470946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-22baca0f-d9e7-423a-bb8a-7df576f7343a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:03.472098 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-22baca0f-d9e7-423a-bb8a-7df576f7343a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:03.475717 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-22baca0f-d9e7-423a-bb8a-7df576f7343a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:03.475717 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-22baca0f-d9e7-423a-bb8a-7df576f7343a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:03.477132 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-22baca0f-d9e7-423a-bb8a-7df576f7343a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:03.479478 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-22baca0f-d9e7-423a-bb8a-7df576f7343a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:03.705162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-22baca0f-d9e7-423a-bb8a-7df576f7343a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:03.722435 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-22baca0f-d9e7-423a-bb8a-7df576f7343a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.276257 Aug 26 06:18:03.723442 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 103/200] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:03 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:04.763541 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a790bbbc-21e9-40f5-afed-9ef20c566960 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:04.764740 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a790bbbc-21e9-40f5-afed-9ef20c566960 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:04.775893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a790bbbc-21e9-40f5-afed-9ef20c566960 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:04.777079 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a790bbbc-21e9-40f5-afed-9ef20c566960 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:04.777677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a790bbbc-21e9-40f5-afed-9ef20c566960 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:04.778570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a790bbbc-21e9-40f5-afed-9ef20c566960 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:04.779688 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a790bbbc-21e9-40f5-afed-9ef20c566960 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:04.780267 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a790bbbc-21e9-40f5-afed-9ef20c566960 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:05.032139 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a790bbbc-21e9-40f5-afed-9ef20c566960 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:05.042996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a790bbbc-21e9-40f5-afed-9ef20c566960 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.288400 Aug 26 06:18:05.044106 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 98/201] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:04 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:06.074201 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-37334aff-1954-4c70-aa60-fc1f91beb297 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:06.075024 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-37334aff-1954-4c70-aa60-fc1f91beb297 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:06.085530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-37334aff-1954-4c70-aa60-fc1f91beb297 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:06.086869 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-37334aff-1954-4c70-aa60-fc1f91beb297 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:06.087767 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-37334aff-1954-4c70-aa60-fc1f91beb297 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:06.087937 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-37334aff-1954-4c70-aa60-fc1f91beb297 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:06.088417 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-37334aff-1954-4c70-aa60-fc1f91beb297 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:06.088883 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-37334aff-1954-4c70-aa60-fc1f91beb297 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:06.245323 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-37334aff-1954-4c70-aa60-fc1f91beb297 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:06.255793 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-37334aff-1954-4c70-aa60-fc1f91beb297 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.185498 Aug 26 06:18:06.256559 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 104/202] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:06 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:07.283070 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7de6d837-3435-45dc-a08c-e1877093f3d1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:07.284312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7de6d837-3435-45dc-a08c-e1877093f3d1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:07.291249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7de6d837-3435-45dc-a08c-e1877093f3d1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:07.292034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7de6d837-3435-45dc-a08c-e1877093f3d1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:07.292642 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7de6d837-3435-45dc-a08c-e1877093f3d1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:07.293599 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7de6d837-3435-45dc-a08c-e1877093f3d1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:07.294196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7de6d837-3435-45dc-a08c-e1877093f3d1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:07.294798 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7de6d837-3435-45dc-a08c-e1877093f3d1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:07.607273 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7de6d837-3435-45dc-a08c-e1877093f3d1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:07.619719 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7de6d837-3435-45dc-a08c-e1877093f3d1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.340932 Aug 26 06:18:07.640780 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 99/203] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:07 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:08.648094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1bf9dc51-e10a-4d46-9439-b3c09b0cf245 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:08.648798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1bf9dc51-e10a-4d46-9439-b3c09b0cf245 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:08.655497 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1bf9dc51-e10a-4d46-9439-b3c09b0cf245 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:08.656078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1bf9dc51-e10a-4d46-9439-b3c09b0cf245 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:08.656520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1bf9dc51-e10a-4d46-9439-b3c09b0cf245 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:08.657215 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1bf9dc51-e10a-4d46-9439-b3c09b0cf245 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:08.657848 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1bf9dc51-e10a-4d46-9439-b3c09b0cf245 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:08.658272 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1bf9dc51-e10a-4d46-9439-b3c09b0cf245 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:08.805463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1bf9dc51-e10a-4d46-9439-b3c09b0cf245 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:08.823699 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1bf9dc51-e10a-4d46-9439-b3c09b0cf245 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1522 microversion: 2.1 time: 0.179505 Aug 26 06:18:08.824325 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 105/204] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:08 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:09.858057 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-965ec0ba-7f93-4b7e-a5e8-33cef7a5ba8a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:09.858057 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-965ec0ba-7f93-4b7e-a5e8-33cef7a5ba8a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:09.858057 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-965ec0ba-7f93-4b7e-a5e8-33cef7a5ba8a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:09.858057 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-965ec0ba-7f93-4b7e-a5e8-33cef7a5ba8a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:09.859158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-965ec0ba-7f93-4b7e-a5e8-33cef7a5ba8a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:09.859158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-965ec0ba-7f93-4b7e-a5e8-33cef7a5ba8a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:09.859158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-965ec0ba-7f93-4b7e-a5e8-33cef7a5ba8a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:09.859158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-965ec0ba-7f93-4b7e-a5e8-33cef7a5ba8a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:10.100122 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-965ec0ba-7f93-4b7e-a5e8-33cef7a5ba8a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:10.116512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-965ec0ba-7f93-4b7e-a5e8-33cef7a5ba8a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1502 microversion: 2.1 time: 0.272470 Aug 26 06:18:10.131875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 100/205] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:09 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1502 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:10.152177 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-375704c8-b3d1-4d90-b006-6a7ffbbbae81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:10.152881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-375704c8-b3d1-4d90-b006-6a7ffbbbae81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:10.160773 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-375704c8-b3d1-4d90-b006-6a7ffbbbae81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:10.162328 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-375704c8-b3d1-4d90-b006-6a7ffbbbae81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:10.163211 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-375704c8-b3d1-4d90-b006-6a7ffbbbae81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:10.164559 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-375704c8-b3d1-4d90-b006-6a7ffbbbae81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:10.165320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-375704c8-b3d1-4d90-b006-6a7ffbbbae81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:10.166178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-375704c8-b3d1-4d90-b006-6a7ffbbbae81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:10.362976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-375704c8-b3d1-4d90-b006-6a7ffbbbae81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:10.375534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-375704c8-b3d1-4d90-b006-6a7ffbbbae81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1515 microversion: 2.1 time: 0.227874 Aug 26 06:18:10.375534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 106/206] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:10 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:12.750850 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4d4b9c56-0eb3-42e2-9c9d-1fbe778c6d07 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:12.757849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4d4b9c56-0eb3-42e2-9c9d-1fbe778c6d07 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:12.776285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d4b9c56-0eb3-42e2-9c9d-1fbe778c6d07 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:12.776815 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d4b9c56-0eb3-42e2-9c9d-1fbe778c6d07 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:12.777394 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d4b9c56-0eb3-42e2-9c9d-1fbe778c6d07 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:12.778257 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d4b9c56-0eb3-42e2-9c9d-1fbe778c6d07 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:12.779077 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d4b9c56-0eb3-42e2-9c9d-1fbe778c6d07 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:12.779802 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4d4b9c56-0eb3-42e2-9c9d-1fbe778c6d07 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:12.824776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-4d4b9c56-0eb3-42e2-9c9d-1fbe778c6d07 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lazy-loading 'flavor' on Instance uuid 3647fa12-4de4-4b81-aca1-4687ec0af8f9 {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:18:13.409393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4d4b9c56-0eb3-42e2-9c9d-1fbe778c6d07 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "POST /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9/action" status: 200 len: 32 microversion: 2.1 time: 0.656713 Aug 26 06:18:13.412483 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 101/207] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:18:12 2022] POST /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9/action => generated 32 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 06:18:13.423419 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ea32ca6e-6d71-495b-aa0e-eeabe1db4a80 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:13.424678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ea32ca6e-6d71-495b-aa0e-eeabe1db4a80 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:13.431476 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:13.433895 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea32ca6e-6d71-495b-aa0e-eeabe1db4a80 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:13.434399 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea32ca6e-6d71-495b-aa0e-eeabe1db4a80 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:13.434948 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea32ca6e-6d71-495b-aa0e-eeabe1db4a80 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:13.436695 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea32ca6e-6d71-495b-aa0e-eeabe1db4a80 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:13.437159 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea32ca6e-6d71-495b-aa0e-eeabe1db4a80 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:13.437757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea32ca6e-6d71-495b-aa0e-eeabe1db4a80 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:13.597368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ea32ca6e-6d71-495b-aa0e-eeabe1db4a80 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:13.606518 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ea32ca6e-6d71-495b-aa0e-eeabe1db4a80 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.187717 Aug 26 06:18:13.607867 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 107/208] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:13 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:14.641549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0d2dedf2-3032-44cf-bfe0-f40b73974e43 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:14.642759 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0d2dedf2-3032-44cf-bfe0-f40b73974e43 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:14.654701 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d2dedf2-3032-44cf-bfe0-f40b73974e43 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:14.656080 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d2dedf2-3032-44cf-bfe0-f40b73974e43 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:14.657196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d2dedf2-3032-44cf-bfe0-f40b73974e43 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:14.658996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d2dedf2-3032-44cf-bfe0-f40b73974e43 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:14.660207 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d2dedf2-3032-44cf-bfe0-f40b73974e43 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:14.661185 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d2dedf2-3032-44cf-bfe0-f40b73974e43 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:15.403826 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0d2dedf2-3032-44cf-bfe0-f40b73974e43 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:15.428949 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0d2dedf2-3032-44cf-bfe0-f40b73974e43 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.795895 Aug 26 06:18:15.433425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 102/209] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:14 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:16.452310 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ac65162e-3781-496e-a41c-d7233103a0bf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:16.453985 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ac65162e-3781-496e-a41c-d7233103a0bf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:16.465070 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac65162e-3781-496e-a41c-d7233103a0bf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:16.465813 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac65162e-3781-496e-a41c-d7233103a0bf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:16.466429 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac65162e-3781-496e-a41c-d7233103a0bf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:16.478858 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac65162e-3781-496e-a41c-d7233103a0bf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:16.478858 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac65162e-3781-496e-a41c-d7233103a0bf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:16.478858 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac65162e-3781-496e-a41c-d7233103a0bf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:16.769791 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ac65162e-3781-496e-a41c-d7233103a0bf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:16.785512 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ac65162e-3781-496e-a41c-d7233103a0bf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.337496 Aug 26 06:18:16.786980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 108/210] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:16 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:17.797309 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-15371421-ab72-4cc0-bfc0-74f27b4486ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:17.798067 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-15371421-ab72-4cc0-bfc0-74f27b4486ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:17.816686 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=36 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:17.818650 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15371421-ab72-4cc0-bfc0-74f27b4486ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:17.819250 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15371421-ab72-4cc0-bfc0-74f27b4486ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:17.824493 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15371421-ab72-4cc0-bfc0-74f27b4486ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:17.824896 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a97ec359-910f-40a9-bda0-33e147ac4be9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:17.825483 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15371421-ab72-4cc0-bfc0-74f27b4486ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:17.825593 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a97ec359-910f-40a9-bda0-33e147ac4be9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:17.825682 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15371421-ab72-4cc0-bfc0-74f27b4486ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:17.825682 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15371421-ab72-4cc0-bfc0-74f27b4486ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:17.830328 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a97ec359-910f-40a9-bda0-33e147ac4be9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:17.831209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a97ec359-910f-40a9-bda0-33e147ac4be9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:17.831966 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a97ec359-910f-40a9-bda0-33e147ac4be9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:17.833648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a97ec359-910f-40a9-bda0-33e147ac4be9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:17.834312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a97ec359-910f-40a9-bda0-33e147ac4be9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:17.835149 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a97ec359-910f-40a9-bda0-33e147ac4be9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:17.870961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-15371421-ab72-4cc0-bfc0-74f27b4486ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/ips" status: 200 len: 145 microversion: 2.1 time: 0.078622 Aug 26 06:18:17.884381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 103/211] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 06:18:17 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/ips => generated 145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:18:18.155036 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a97ec359-910f-40a9-bda0-33e147ac4be9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:18.172049 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a97ec359-910f-40a9-bda0-33e147ac4be9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.358372 Aug 26 06:18:18.185769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 109/212] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:17 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:19.201529 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-883f3f3b-4e66-4daa-a53b-5b2fe5418f05 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:19.202758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-883f3f3b-4e66-4daa-a53b-5b2fe5418f05 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:19.214995 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-883f3f3b-4e66-4daa-a53b-5b2fe5418f05 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:19.215527 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-883f3f3b-4e66-4daa-a53b-5b2fe5418f05 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:19.219547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-883f3f3b-4e66-4daa-a53b-5b2fe5418f05 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:19.230935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-883f3f3b-4e66-4daa-a53b-5b2fe5418f05 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:19.231808 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-883f3f3b-4e66-4daa-a53b-5b2fe5418f05 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:19.232555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-883f3f3b-4e66-4daa-a53b-5b2fe5418f05 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:19.457347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-883f3f3b-4e66-4daa-a53b-5b2fe5418f05 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:19.468782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-883f3f3b-4e66-4daa-a53b-5b2fe5418f05 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.270916 Aug 26 06:18:19.469811 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 104/213] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:19 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:19.809318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-583724499", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "networks": [{"uuid": "be8035ab-d66f-4876-a168-341d4ebde9a9"}]}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:19.884914 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] validate_networks() for [('be8035ab-d66f-4876-a168-341d4ebde9a9', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:18:20.495776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-1584f2a5-5100-42d0-9d7c-f54c6214a3ba tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:20.496436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1584f2a5-5100-42d0-9d7c-f54c6214a3ba tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:20.506865 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1584f2a5-5100-42d0-9d7c-f54c6214a3ba tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:20.507614 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1584f2a5-5100-42d0-9d7c-f54c6214a3ba tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:20.512694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1584f2a5-5100-42d0-9d7c-f54c6214a3ba tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:20.515317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1584f2a5-5100-42d0-9d7c-f54c6214a3ba tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:20.515919 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1584f2a5-5100-42d0-9d7c-f54c6214a3ba tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:20.519086 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1584f2a5-5100-42d0-9d7c-f54c6214a3ba tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:20.821296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:18:20.821783 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:18:20.822199 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:18:20.822653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:18:20.823052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:18:20.848739 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1584f2a5-5100-42d0-9d7c-f54c6214a3ba tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:20.856515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:20.857113 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:20.857558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:20.858355 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:20.859799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-1584f2a5-5100-42d0-9d7c-f54c6214a3ba tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.371314 Aug 26 06:18:20.860796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:20.862107 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:20.875049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 105/214] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:20 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:20.889731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Getting quotas for project 7e90dec3a44a4763b0045af64212fc15. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:18:20.896042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Getting quotas for user 543a9cddd92a44c78c26e5b8400e0c98 and project 7e90dec3a44a4763b0045af64212fc15. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:18:20.924818 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:18:20.930005 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:18:21.237327 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8b5f7bb7-8a73-4289-9c55-900aaf03e05e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.433434 Aug 26 06:18:21.239204 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 110/215] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:18:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:18:21.251118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ace9b884-d17d-40d7-b056-3df81b6fac9c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:21.251970 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ace9b884-d17d-40d7-b056-3df81b6fac9c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:21.332013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ace9b884-d17d-40d7-b056-3df81b6fac9c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:21.340293 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ace9b884-d17d-40d7-b056-3df81b6fac9c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1218 microversion: 2.1 time: 0.093200 Aug 26 06:18:21.341228 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 106/216] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:21 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:21.903176 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-449e80f8-14a5-49f4-9224-72e4039b238e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:21.904124 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-449e80f8-14a5-49f4-9224-72e4039b238e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:21.948376 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-449e80f8-14a5-49f4-9224-72e4039b238e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:21.948916 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-449e80f8-14a5-49f4-9224-72e4039b238e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:21.949347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-449e80f8-14a5-49f4-9224-72e4039b238e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:21.950079 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-449e80f8-14a5-49f4-9224-72e4039b238e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:21.956278 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-449e80f8-14a5-49f4-9224-72e4039b238e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:21.959385 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-449e80f8-14a5-49f4-9224-72e4039b238e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:22.297240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-449e80f8-14a5-49f4-9224-72e4039b238e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:22.309800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-449e80f8-14a5-49f4-9224-72e4039b238e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.427035 Aug 26 06:18:22.313290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 111/217] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:21 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:22.368035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-650d88d9-c24d-4efd-9b7d-34766007700f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:22.368649 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-650d88d9-c24d-4efd-9b7d-34766007700f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:22.473905 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4865e05c-a464-4215-b9c6-af423c9ef452 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Action: 'create', calling method: .version_select at 0x7f2f094108b0>, body: {"keypair": {"name": "tempest-keypair-890970038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7ouYPbvYVZOGEAk/lbr94dOTvIRiMUA3aaEXDxuiBLsI+iw7HU6tBXIJz6Y7WLQBN0EbYDE/udZhqBpsKP5tV0EXepmk99SxKTMnixW+qbfleQa+tbjDpHsr7IA8P+cw=="}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:22.493309 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-650d88d9-c24d-4efd-9b7d-34766007700f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:22.503645 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-4865e05c-a464-4215-b9c6-af423c9ef452 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Getting quotas for project f7e0c375a58842e18a4306779fd6e167. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:18:22.506721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-650d88d9-c24d-4efd-9b7d-34766007700f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1218 microversion: 2.1 time: 0.142689 Aug 26 06:18:22.510442 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 112/218] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:22 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:22.511402 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-4865e05c-a464-4215-b9c6-af423c9ef452 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Getting quotas for user 660c6df77d0a4750aac30345d6768526 and project f7e0c375a58842e18a4306779fd6e167. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:18:22.774734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4865e05c-a464-4215-b9c6-af423c9ef452 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.511430 Aug 26 06:18:22.775788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 107/219] 10.222.0.40 () {62 vars in 1200 bytes} [Fri Aug 26 06:18:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 514 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 06:18:23.335651 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-208a54f3-9ff9-4964-a6fe-7a5fd3a07178 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:23.336198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-208a54f3-9ff9-4964-a6fe-7a5fd3a07178 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:23.345942 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-208a54f3-9ff9-4964-a6fe-7a5fd3a07178 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:23.346481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-208a54f3-9ff9-4964-a6fe-7a5fd3a07178 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:23.347165 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-208a54f3-9ff9-4964-a6fe-7a5fd3a07178 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:23.347874 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-208a54f3-9ff9-4964-a6fe-7a5fd3a07178 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:23.348438 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-208a54f3-9ff9-4964-a6fe-7a5fd3a07178 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:23.349055 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-208a54f3-9ff9-4964-a6fe-7a5fd3a07178 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:23.531307 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-208a54f3-9ff9-4964-a6fe-7a5fd3a07178 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:23.533543 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bea37a7c-4c1a-4fb5-b957-e9c9c8d4702b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:23.534205 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-bea37a7c-4c1a-4fb5-b957-e9c9c8d4702b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:23.546164 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bea37a7c-4c1a-4fb5-b957-e9c9c8d4702b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:23.546164 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bea37a7c-4c1a-4fb5-b957-e9c9c8d4702b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:23.546446 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-208a54f3-9ff9-4964-a6fe-7a5fd3a07178 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.213468 Aug 26 06:18:23.546536 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bea37a7c-4c1a-4fb5-b957-e9c9c8d4702b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:23.546536 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bea37a7c-4c1a-4fb5-b957-e9c9c8d4702b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:23.546536 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bea37a7c-4c1a-4fb5-b957-e9c9c8d4702b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:23.546536 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bea37a7c-4c1a-4fb5-b957-e9c9c8d4702b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:23.546987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 113/220] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:23 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:23.615552 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-36925d99-c488-48cd-8d0f-2b42afa86a08 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c321585d-7090-43ec-91ed-4209a1e3326f"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:23.621469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-36925d99-c488-48cd-8d0f-2b42afa86a08 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:23.629872 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36925d99-c488-48cd-8d0f-2b42afa86a08 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:23.630505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36925d99-c488-48cd-8d0f-2b42afa86a08 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:23.634268 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36925d99-c488-48cd-8d0f-2b42afa86a08 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:23.634268 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36925d99-c488-48cd-8d0f-2b42afa86a08 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:23.634268 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36925d99-c488-48cd-8d0f-2b42afa86a08 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:23.634268 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36925d99-c488-48cd-8d0f-2b42afa86a08 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:23.638061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bea37a7c-4c1a-4fb5-b957-e9c9c8d4702b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:23.646723 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bea37a7c-4c1a-4fb5-b957-e9c9c8d4702b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1222 microversion: 2.1 time: 0.116925 Aug 26 06:18:23.647758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 108/221] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:23 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:23.659983 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:24.565619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8c2d0725-00eb-45db-9148-18b4902e50b5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:24.566228 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8c2d0725-00eb-45db-9148-18b4902e50b5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:24.572619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c2d0725-00eb-45db-9148-18b4902e50b5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:24.573105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c2d0725-00eb-45db-9148-18b4902e50b5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:24.573733 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c2d0725-00eb-45db-9148-18b4902e50b5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:24.574440 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c2d0725-00eb-45db-9148-18b4902e50b5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:24.574988 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c2d0725-00eb-45db-9148-18b4902e50b5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:24.575408 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8c2d0725-00eb-45db-9148-18b4902e50b5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:24.758866 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8c2d0725-00eb-45db-9148-18b4902e50b5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:24.770010 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8c2d0725-00eb-45db-9148-18b4902e50b5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.207641 Aug 26 06:18:24.774079 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 109/222] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:24 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:24.781657 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-769f43c7-d2e7-499a-a1e0-7a941bf66ada tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:24.783302 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-769f43c7-d2e7-499a-a1e0-7a941bf66ada tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:24.795683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-769f43c7-d2e7-499a-a1e0-7a941bf66ada tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:24.795683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-769f43c7-d2e7-499a-a1e0-7a941bf66ada tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:24.795683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-769f43c7-d2e7-499a-a1e0-7a941bf66ada tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:24.795683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-769f43c7-d2e7-499a-a1e0-7a941bf66ada tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:24.796141 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-769f43c7-d2e7-499a-a1e0-7a941bf66ada tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:24.796141 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-769f43c7-d2e7-499a-a1e0-7a941bf66ada tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:24.886816 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-769f43c7-d2e7-499a-a1e0-7a941bf66ada tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:24.899119 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-769f43c7-d2e7-499a-a1e0-7a941bf66ada tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1270 microversion: 2.1 time: 0.121084 Aug 26 06:18:24.899947 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 110/223] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:24 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:25.248661 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-36925d99-c488-48cd-8d0f-2b42afa86a08 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "POST /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.638411 Aug 26 06:18:25.249488 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 114/224] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:18:23 2022] POST /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/os-volume_attachments => generated 194 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:18:25.793116 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-87139924-325b-4b78-a4ac-28942b3f455c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:25.795098 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-87139924-325b-4b78-a4ac-28942b3f455c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:25.801564 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-87139924-325b-4b78-a4ac-28942b3f455c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:25.802053 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-87139924-325b-4b78-a4ac-28942b3f455c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:25.803070 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-87139924-325b-4b78-a4ac-28942b3f455c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:25.803790 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-87139924-325b-4b78-a4ac-28942b3f455c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:25.807521 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-87139924-325b-4b78-a4ac-28942b3f455c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:25.807521 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-87139924-325b-4b78-a4ac-28942b3f455c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:25.923036 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d5d6cfd0-e88c-4714-9118-4a3372d8fe30 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:25.924195 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d5d6cfd0-e88c-4714-9118-4a3372d8fe30 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:25.936144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5d6cfd0-e88c-4714-9118-4a3372d8fe30 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:25.936635 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5d6cfd0-e88c-4714-9118-4a3372d8fe30 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:25.937197 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5d6cfd0-e88c-4714-9118-4a3372d8fe30 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:25.937766 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5d6cfd0-e88c-4714-9118-4a3372d8fe30 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:25.939245 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5d6cfd0-e88c-4714-9118-4a3372d8fe30 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:25.939853 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5d6cfd0-e88c-4714-9118-4a3372d8fe30 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:26.039955 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d5d6cfd0-e88c-4714-9118-4a3372d8fe30 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:26.063281 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d5d6cfd0-e88c-4714-9118-4a3372d8fe30 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1270 microversion: 2.1 time: 0.142493 Aug 26 06:18:26.063281 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 115/225] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:25 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1270 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:26.198796 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-87139924-325b-4b78-a4ac-28942b3f455c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:26.214104 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-87139924-325b-4b78-a4ac-28942b3f455c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.425028 Aug 26 06:18:26.229618 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 111/226] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:25 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:27.087401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-84d21139-f039-44ed-a555-a6094e689316 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:27.088083 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-84d21139-f039-44ed-a555-a6094e689316 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:27.095855 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-84d21139-f039-44ed-a555-a6094e689316 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:27.096349 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-84d21139-f039-44ed-a555-a6094e689316 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:27.096870 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-84d21139-f039-44ed-a555-a6094e689316 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:27.097630 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-84d21139-f039-44ed-a555-a6094e689316 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:27.098078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-84d21139-f039-44ed-a555-a6094e689316 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:27.098505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-84d21139-f039-44ed-a555-a6094e689316 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:27.198137 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-84d21139-f039-44ed-a555-a6094e689316 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:27.213806 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-84d21139-f039-44ed-a555-a6094e689316 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1288 microversion: 2.1 time: 0.130799 Aug 26 06:18:27.226670 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 116/227] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:27 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1288 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:27.242028 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-aab26011-08e8-4c69-86ae-895177c81550 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:27.242875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-aab26011-08e8-4c69-86ae-895177c81550 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:27.249798 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aab26011-08e8-4c69-86ae-895177c81550 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:27.250716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aab26011-08e8-4c69-86ae-895177c81550 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:27.251513 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aab26011-08e8-4c69-86ae-895177c81550 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:27.252441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aab26011-08e8-4c69-86ae-895177c81550 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:27.252898 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aab26011-08e8-4c69-86ae-895177c81550 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:27.253319 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aab26011-08e8-4c69-86ae-895177c81550 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:27.426540 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-aab26011-08e8-4c69-86ae-895177c81550 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:27.435354 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-aab26011-08e8-4c69-86ae-895177c81550 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.197749 Aug 26 06:18:27.436132 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 112/228] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:27 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:28.101428 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-528985054", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0329fd48-f6a9-4c16-8004-ab5a1f76eb8f"}], "security_groups": [{"name": "tempest-securitygroup--1582935553"}], "key_name": "tempest-keypair-890970038", "user_data": "}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:28.242004 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-859c654b-43a8-4311-ada1-750d743a8c7b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:28.242635 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-859c654b-43a8-4311-ada1-750d743a8c7b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:28.259054 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-859c654b-43a8-4311-ada1-750d743a8c7b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:28.259054 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-859c654b-43a8-4311-ada1-750d743a8c7b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:28.259054 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-859c654b-43a8-4311-ada1-750d743a8c7b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:28.261881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] validate_networks() for [('0329fd48-f6a9-4c16-8004-ab5a1f76eb8f', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:18:28.268346 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-859c654b-43a8-4311-ada1-750d743a8c7b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:28.268346 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-859c654b-43a8-4311-ada1-750d743a8c7b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:28.268346 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-859c654b-43a8-4311-ada1-750d743a8c7b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:28.550210 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-859c654b-43a8-4311-ada1-750d743a8c7b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:28.553033 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:28.560770 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-859c654b-43a8-4311-ada1-750d743a8c7b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.323269 Aug 26 06:18:28.561363 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 113/229] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:28 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:28.574892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c3f68120-429b-4c60-9226-0ce42cd115ef tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:28.574892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c3f68120-429b-4c60-9226-0ce42cd115ef tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:28.574892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c3f68120-429b-4c60-9226-0ce42cd115ef tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:28.574892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c3f68120-429b-4c60-9226-0ce42cd115ef tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:28.575516 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c3f68120-429b-4c60-9226-0ce42cd115ef tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:28.575516 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c3f68120-429b-4c60-9226-0ce42cd115ef tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:28.575516 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c3f68120-429b-4c60-9226-0ce42cd115ef tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:28.575941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c3f68120-429b-4c60-9226-0ce42cd115ef tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:28.732131 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:18:28.742072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:18:28.742072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:18:28.742072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:18:28.742072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:18:28.745292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:28.745727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:28.746158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:28.746977 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:28.747434 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:28.747871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:28.767072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Getting quotas for project f7e0c375a58842e18a4306779fd6e167. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:18:28.771714 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Getting quotas for user 660c6df77d0a4750aac30345d6768526 and project f7e0c375a58842e18a4306779fd6e167. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:18:28.786583 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:18:28.793584 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:18:28.810731 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c3f68120-429b-4c60-9226-0ce42cd115ef tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:28.820889 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c3f68120-429b-4c60-9226-0ce42cd115ef tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.258449 Aug 26 06:18:28.821582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 114/230] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:28 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:28.929855 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-760183954", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452"}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:28.987893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.network.neutron [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] validate_networks() for None {{(pid=121343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:18:29.123356 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d3a796c6-dbbf-4d74-856f-8515858f9612 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.029339 Aug 26 06:18:29.131691 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 117/231] 10.222.0.40 () {62 vars in 1188 bytes} [Fri Aug 26 06:18:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 06:18:29.142512 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ccc4b90a-4388-4239-a23b-bd9936fbf62e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:29.143264 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ccc4b90a-4388-4239-a23b-bd9936fbf62e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:29.206826 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ccc4b90a-4388-4239-a23b-bd9936fbf62e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:29.216658 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ccc4b90a-4388-4239-a23b-bd9936fbf62e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:29.218514 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ccc4b90a-4388-4239-a23b-bd9936fbf62e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:29.219993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ccc4b90a-4388-4239-a23b-bd9936fbf62e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1280 microversion: 2.20 time: 0.085832 Aug 26 06:18:29.220780 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 118/232] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:29 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:29.442803 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Flavor limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:18:29.444543 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Image limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:18:29.444543 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Flavor pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:18:29.444708 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Image pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:18:29.445216 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:18:29.454721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:29.455344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:29.455949 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:29.456728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:29.457277 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:29.457604 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:29.476035 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Getting quotas for project 1b173feb98cc4a2788019d9ad62b384f. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:18:29.480231 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Getting quotas for user 0901c2e1c6114d62babc509c46d26b7d and project 1b173feb98cc4a2788019d9ad62b384f. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:18:29.491448 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Going to run 1 instances... {{(pid=121343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:18:29.493753 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:18:29.595086 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5442bed5-7e68-406d-a9ce-34496ba1a4db tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:29.595716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5442bed5-7e68-406d-a9ce-34496ba1a4db tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:29.602500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5442bed5-7e68-406d-a9ce-34496ba1a4db tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:29.603083 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5442bed5-7e68-406d-a9ce-34496ba1a4db tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:29.603535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5442bed5-7e68-406d-a9ce-34496ba1a4db tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:29.604251 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5442bed5-7e68-406d-a9ce-34496ba1a4db tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:29.604707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5442bed5-7e68-406d-a9ce-34496ba1a4db tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:29.605136 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5442bed5-7e68-406d-a9ce-34496ba1a4db tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:29.774264 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5442bed5-7e68-406d-a9ce-34496ba1a4db tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:29.787143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5442bed5-7e68-406d-a9ce-34496ba1a4db tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.195698 Aug 26 06:18:29.793480 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 119/233] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:29 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:29.793480 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-a595dd38-f590-4e8c-a906-123d56b280d1 req-b7c34ad7-17ba-4ba3-a5ed-8f4919fd4d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a23686-df31-4e61-879f-e1b1eaaef0ea", "tag": "8f33f7d7-7e9a-4e62-9cc6-849887fde715"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:29.805648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a595dd38-f590-4e8c-a906-123d56b280d1 req-b7c34ad7-17ba-4ba3-a5ed-8f4919fd4d0e service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:29.806416 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a595dd38-f590-4e8c-a906-123d56b280d1 req-b7c34ad7-17ba-4ba3-a5ed-8f4919fd4d0e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:29.807078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a595dd38-f590-4e8c-a906-123d56b280d1 req-b7c34ad7-17ba-4ba3-a5ed-8f4919fd4d0e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:29.808437 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-43650d60-1f83-45fc-bba1-318292ff486c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883299 Aug 26 06:18:29.811240 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 115/234] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:18:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 06:18:29.822955 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-a595dd38-f590-4e8c-a906-123d56b280d1 req-b7c34ad7-17ba-4ba3-a5ed-8f4919fd4d0e service nova] Creating event network-changed:8f33f7d7-7e9a-4e62-9cc6-849887fde715 for instance 40a23686-df31-4e61-879f-e1b1eaaef0ea on hv-cinder-85391 Aug 26 06:18:29.823171 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-72e080e6-bec2-4fe5-a6f7-d66f78372ac4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:29.828205 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-72e080e6-bec2-4fe5-a6f7-d66f78372ac4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:29.828764 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-a595dd38-f590-4e8c-a906-123d56b280d1 req-b7c34ad7-17ba-4ba3-a5ed-8f4919fd4d0e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039516 Aug 26 06:18:29.829798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 120/235] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:18:29.847303 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5a4c478d-8bf3-4af3-adb4-cd908643a512 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:29.849002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5a4c478d-8bf3-4af3-adb4-cd908643a512 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:29.857313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a4c478d-8bf3-4af3-adb4-cd908643a512 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:29.858058 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a4c478d-8bf3-4af3-adb4-cd908643a512 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:29.859237 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a4c478d-8bf3-4af3-adb4-cd908643a512 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:29.860126 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a4c478d-8bf3-4af3-adb4-cd908643a512 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:29.860728 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a4c478d-8bf3-4af3-adb4-cd908643a512 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:29.861436 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a4c478d-8bf3-4af3-adb4-cd908643a512 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:30.031340 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-72e080e6-bec2-4fe5-a6f7-d66f78372ac4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:30.044714 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-72e080e6-bec2-4fe5-a6f7-d66f78372ac4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1214 microversion: 2.1 time: 0.222293 Aug 26 06:18:30.045778 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 116/236] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:29 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:30.090769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5a4c478d-8bf3-4af3-adb4-cd908643a512 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:30.109291 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5a4c478d-8bf3-4af3-adb4-cd908643a512 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.271181 Aug 26 06:18:30.111374 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 121/237] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:29 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:30.247855 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-62cb9072-a6ff-4805-8c2b-c2325d3a3fbb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:30.247855 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-62cb9072-a6ff-4805-8c2b-c2325d3a3fbb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:30.348019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-62cb9072-a6ff-4805-8c2b-c2325d3a3fbb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:30.359936 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-62cb9072-a6ff-4805-8c2b-c2325d3a3fbb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:30.362477 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-62cb9072-a6ff-4805-8c2b-c2325d3a3fbb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:30.364473 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-62cb9072-a6ff-4805-8c2b-c2325d3a3fbb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1280 microversion: 2.20 time: 0.122543 Aug 26 06:18:30.366145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 117/238] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:30 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1280 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:30.813777 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f553190c-c2ed-4468-b31d-bed8868947cd tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:30.814856 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f553190c-c2ed-4468-b31d-bed8868947cd tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:30.821659 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f553190c-c2ed-4468-b31d-bed8868947cd tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:30.822169 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f553190c-c2ed-4468-b31d-bed8868947cd tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:30.822689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f553190c-c2ed-4468-b31d-bed8868947cd tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:30.823372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f553190c-c2ed-4468-b31d-bed8868947cd tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:30.823832 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f553190c-c2ed-4468-b31d-bed8868947cd tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:30.824253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f553190c-c2ed-4468-b31d-bed8868947cd tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:30.957606 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f553190c-c2ed-4468-b31d-bed8868947cd tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:30.966077 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f553190c-c2ed-4468-b31d-bed8868947cd tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.156401 Aug 26 06:18:30.966638 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 122/239] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:30 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:31.065637 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c22895c4-256e-4cf2-a53e-4e21221e12fb tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:31.066246 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c22895c4-256e-4cf2-a53e-4e21221e12fb tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:31.121135 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c22895c4-256e-4cf2-a53e-4e21221e12fb tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:31.128414 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c22895c4-256e-4cf2-a53e-4e21221e12fb tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1214 microversion: 2.1 time: 0.066681 Aug 26 06:18:31.129023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 118/240] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:31 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:31.135495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3bf19871-6adb-45d3-96af-ae6b3815620c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:31.136135 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3bf19871-6adb-45d3-96af-ae6b3815620c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:31.142845 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3bf19871-6adb-45d3-96af-ae6b3815620c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:31.143360 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3bf19871-6adb-45d3-96af-ae6b3815620c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:31.143797 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3bf19871-6adb-45d3-96af-ae6b3815620c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:31.144555 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3bf19871-6adb-45d3-96af-ae6b3815620c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:31.145013 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3bf19871-6adb-45d3-96af-ae6b3815620c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:31.145439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3bf19871-6adb-45d3-96af-ae6b3815620c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:31.295171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3bf19871-6adb-45d3-96af-ae6b3815620c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:31.304066 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3bf19871-6adb-45d3-96af-ae6b3815620c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.173468 Aug 26 06:18:31.321880 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 123/241] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:31 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:31.390317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:31.391030 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:31.405991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:31.406589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:31.413569 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:31.413569 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:31.413569 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:31.413569 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:31.499421 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:31.508654 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:31.510092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:31.511289 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9be30e0e-1df7-4d86-bfe0-b4b10797ba52 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1284 microversion: 2.20 time: 0.126044 Aug 26 06:18:31.511834 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 119/242] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:31 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:31.986048 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-92abf9bc-a8e6-4409-8def-c15124a57ff8 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:31.986673 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-92abf9bc-a8e6-4409-8def-c15124a57ff8 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:31.993618 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-92abf9bc-a8e6-4409-8def-c15124a57ff8 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:31.994089 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-92abf9bc-a8e6-4409-8def-c15124a57ff8 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:31.994520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-92abf9bc-a8e6-4409-8def-c15124a57ff8 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:31.995234 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-92abf9bc-a8e6-4409-8def-c15124a57ff8 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:31.995687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-92abf9bc-a8e6-4409-8def-c15124a57ff8 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:31.996109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-92abf9bc-a8e6-4409-8def-c15124a57ff8 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:32.131692 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-92abf9bc-a8e6-4409-8def-c15124a57ff8 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:32.140255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-92abf9bc-a8e6-4409-8def-c15124a57ff8 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.157942 Aug 26 06:18:32.140819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 124/243] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:31 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:32.149938 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-fdd2d21e-58e5-4bc3-a43f-d37b4281a11c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:32.150554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-fdd2d21e-58e5-4bc3-a43f-d37b4281a11c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:32.214344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fdd2d21e-58e5-4bc3-a43f-d37b4281a11c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:32.221550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-fdd2d21e-58e5-4bc3-a43f-d37b4281a11c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1214 microversion: 2.1 time: 0.076006 Aug 26 06:18:32.222127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 120/244] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:32 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:32.329472 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-35e3e61c-36fe-4f11-80b5-10299df29847 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:32.330083 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-35e3e61c-36fe-4f11-80b5-10299df29847 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:32.337114 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-35e3e61c-36fe-4f11-80b5-10299df29847 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:32.337607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-35e3e61c-36fe-4f11-80b5-10299df29847 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:32.338049 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-35e3e61c-36fe-4f11-80b5-10299df29847 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:32.338782 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-35e3e61c-36fe-4f11-80b5-10299df29847 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:32.339245 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-35e3e61c-36fe-4f11-80b5-10299df29847 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:32.345721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-35e3e61c-36fe-4f11-80b5-10299df29847 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:32.474131 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-35e3e61c-36fe-4f11-80b5-10299df29847 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:32.482305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-35e3e61c-36fe-4f11-80b5-10299df29847 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.156845 Aug 26 06:18:32.482875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 125/245] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:32 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:32.534610 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:32.535240 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:32.544189 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:32.545000 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:32.545744 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:32.546976 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:32.547786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:32.548270 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:32.613798 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:32.624017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:32.625528 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:32.626665 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f76bba35-f4b6-4853-81c5-8507ef05b23f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1284 microversion: 2.20 time: 0.096143 Aug 26 06:18:32.627453 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 121/246] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:32 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:18:33.164197 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-70081310-08ba-4cf4-b8cb-fd8b647da53c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:33.164806 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-70081310-08ba-4cf4-b8cb-fd8b647da53c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:33.171758 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70081310-08ba-4cf4-b8cb-fd8b647da53c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:33.172244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70081310-08ba-4cf4-b8cb-fd8b647da53c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:33.172679 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70081310-08ba-4cf4-b8cb-fd8b647da53c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:33.173395 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70081310-08ba-4cf4-b8cb-fd8b647da53c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:33.173834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70081310-08ba-4cf4-b8cb-fd8b647da53c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:33.174262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70081310-08ba-4cf4-b8cb-fd8b647da53c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:33.245460 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7a276432-f1a5-43ef-8fad-858e01f4587d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:33.246072 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7a276432-f1a5-43ef-8fad-858e01f4587d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:33.253154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a276432-f1a5-43ef-8fad-858e01f4587d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:33.253862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a276432-f1a5-43ef-8fad-858e01f4587d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:33.254307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a276432-f1a5-43ef-8fad-858e01f4587d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:33.255064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a276432-f1a5-43ef-8fad-858e01f4587d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:33.255511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a276432-f1a5-43ef-8fad-858e01f4587d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:33.255940 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a276432-f1a5-43ef-8fad-858e01f4587d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:33.539348 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-70081310-08ba-4cf4-b8cb-fd8b647da53c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:33.540606 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7a276432-f1a5-43ef-8fad-858e01f4587d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:33.541125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-70081310-08ba-4cf4-b8cb-fd8b647da53c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.171727 Aug 26 06:18:33.541125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 126/247] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:33 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:33.541601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7a276432-f1a5-43ef-8fad-858e01f4587d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1218 microversion: 2.1 time: 0.103061 Aug 26 06:18:33.541601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 122/248] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:33 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:33.541778 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b2c43028-a696-48ff-b20c-fa725f40e1d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:33.541778 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b2c43028-a696-48ff-b20c-fa725f40e1d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:33.541778 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2c43028-a696-48ff-b20c-fa725f40e1d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:33.541778 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2c43028-a696-48ff-b20c-fa725f40e1d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:33.542091 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2c43028-a696-48ff-b20c-fa725f40e1d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:33.542091 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2c43028-a696-48ff-b20c-fa725f40e1d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:33.542091 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2c43028-a696-48ff-b20c-fa725f40e1d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:33.542091 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2c43028-a696-48ff-b20c-fa725f40e1d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:33.651145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:33.652056 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:33.659962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:33.661425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:33.662866 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:33.663724 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:33.664290 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:33.664849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:33.681298 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b2c43028-a696-48ff-b20c-fa725f40e1d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:33.690183 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b2c43028-a696-48ff-b20c-fa725f40e1d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.190262 Aug 26 06:18:33.690770 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 127/249] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:33 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:33.751586 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:33.762319 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:33.763963 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:33.765082 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b10dd247-cd52-43a9-bb2c-b4d9b00dc5ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1284 microversion: 2.20 time: 0.119234 Aug 26 06:18:33.774659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 123/250] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:33 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:34.355445 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f8604d6e-e485-4abf-b9a1-7428ffbf7260 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:34.356087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f8604d6e-e485-4abf-b9a1-7428ffbf7260 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:34.363272 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f8604d6e-e485-4abf-b9a1-7428ffbf7260 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:34.363795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f8604d6e-e485-4abf-b9a1-7428ffbf7260 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:34.365772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f8604d6e-e485-4abf-b9a1-7428ffbf7260 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:34.365772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f8604d6e-e485-4abf-b9a1-7428ffbf7260 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:34.366047 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f8604d6e-e485-4abf-b9a1-7428ffbf7260 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:34.366658 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f8604d6e-e485-4abf-b9a1-7428ffbf7260 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:34.368398 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8340ade2-2264-4a32-9f6f-ed2a727be301 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:34.369032 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8340ade2-2264-4a32-9f6f-ed2a727be301 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:34.376585 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8340ade2-2264-4a32-9f6f-ed2a727be301 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:34.377373 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8340ade2-2264-4a32-9f6f-ed2a727be301 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:34.377976 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8340ade2-2264-4a32-9f6f-ed2a727be301 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:34.380128 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8340ade2-2264-4a32-9f6f-ed2a727be301 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:34.380870 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8340ade2-2264-4a32-9f6f-ed2a727be301 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:34.381444 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8340ade2-2264-4a32-9f6f-ed2a727be301 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:34.497147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8340ade2-2264-4a32-9f6f-ed2a727be301 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:34.505155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8340ade2-2264-4a32-9f6f-ed2a727be301 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1210 microversion: 2.1 time: 0.142621 Aug 26 06:18:34.518812 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 124/251] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:34 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1210 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:34.571579 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f8604d6e-e485-4abf-b9a1-7428ffbf7260 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:34.594055 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f8604d6e-e485-4abf-b9a1-7428ffbf7260 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.244601 Aug 26 06:18:34.612914 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 128/252] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:34 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:34.712156 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-43904357-e8da-4790-a7e6-bfc4df894d28 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:34.712767 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-43904357-e8da-4790-a7e6-bfc4df894d28 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:34.718969 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43904357-e8da-4790-a7e6-bfc4df894d28 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:34.719459 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43904357-e8da-4790-a7e6-bfc4df894d28 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:34.719892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43904357-e8da-4790-a7e6-bfc4df894d28 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:34.720586 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43904357-e8da-4790-a7e6-bfc4df894d28 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:34.721037 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43904357-e8da-4790-a7e6-bfc4df894d28 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:34.721460 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43904357-e8da-4790-a7e6-bfc4df894d28 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:34.793201 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:34.797221 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:34.801194 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:34.801680 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:34.802143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:34.804381 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:34.804950 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:34.805406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:34.873782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-43904357-e8da-4790-a7e6-bfc4df894d28 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:34.881898 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:34.885281 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-43904357-e8da-4790-a7e6-bfc4df894d28 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.177501 Aug 26 06:18:34.893672 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:34.893672 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:34.894051 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8a350ed7-dd78-4900-b94b-5f99bdae3f51 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1276 microversion: 2.20 time: 0.104542 Aug 26 06:18:34.903223 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 125/253] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:34 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:34.903996 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 129/254] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:34 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:35.531882 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e786a75b-211b-463e-9131-1b07cb2aa8d9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:35.533258 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e786a75b-211b-463e-9131-1b07cb2aa8d9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:35.543631 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e786a75b-211b-463e-9131-1b07cb2aa8d9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:35.545067 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e786a75b-211b-463e-9131-1b07cb2aa8d9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:35.545732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e786a75b-211b-463e-9131-1b07cb2aa8d9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:35.546932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e786a75b-211b-463e-9131-1b07cb2aa8d9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:35.547626 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e786a75b-211b-463e-9131-1b07cb2aa8d9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:35.548410 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e786a75b-211b-463e-9131-1b07cb2aa8d9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:35.622295 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5dae79cc-a715-459f-bf6e-7c02bc02f069 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:35.623071 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5dae79cc-a715-459f-bf6e-7c02bc02f069 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:35.630133 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dae79cc-a715-459f-bf6e-7c02bc02f069 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:35.631296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dae79cc-a715-459f-bf6e-7c02bc02f069 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:35.631729 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dae79cc-a715-459f-bf6e-7c02bc02f069 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:35.632428 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dae79cc-a715-459f-bf6e-7c02bc02f069 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:35.633012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dae79cc-a715-459f-bf6e-7c02bc02f069 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:35.634320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dae79cc-a715-459f-bf6e-7c02bc02f069 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:35.636030 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e786a75b-211b-463e-9131-1b07cb2aa8d9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:35.644141 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e786a75b-211b-463e-9131-1b07cb2aa8d9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1266 microversion: 2.1 time: 0.117051 Aug 26 06:18:35.645276 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 126/255] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:35 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:35.812911 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5dae79cc-a715-459f-bf6e-7c02bc02f069 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:35.823029 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5dae79cc-a715-459f-bf6e-7c02bc02f069 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.204714 Aug 26 06:18:35.823791 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 130/256] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:35 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:35.908403 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3fc7bbf5-c2b8-416f-adcb-457d1fd9f949 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:35.909152 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3fc7bbf5-c2b8-416f-adcb-457d1fd9f949 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:35.916298 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fc7bbf5-c2b8-416f-adcb-457d1fd9f949 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:35.916903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fc7bbf5-c2b8-416f-adcb-457d1fd9f949 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:35.917396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fc7bbf5-c2b8-416f-adcb-457d1fd9f949 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:35.925949 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fc7bbf5-c2b8-416f-adcb-457d1fd9f949 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:35.926445 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:35.926556 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fc7bbf5-c2b8-416f-adcb-457d1fd9f949 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:35.926696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:35.926786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fc7bbf5-c2b8-416f-adcb-457d1fd9f949 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:35.926880 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:35.926880 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:35.927233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:35.928186 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:35.929041 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:35.929798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:36.014835 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:36.040893 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:36.043219 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:36.046999 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a50a2b2f-3afc-425b-813b-8289648e749b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1332 microversion: 2.20 time: 0.132128 Aug 26 06:18:36.048477 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 131/257] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:35 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:18:36.173535 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3fc7bbf5-c2b8-416f-adcb-457d1fd9f949 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:36.182154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3fc7bbf5-c2b8-416f-adcb-457d1fd9f949 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1501 microversion: 2.1 time: 0.277441 Aug 26 06:18:36.182761 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 127/258] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:35 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1501 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:36.204071 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7c60053-d8f3-41ed-b390-1c59ef1eca80"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:36.206604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:36.214889 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:36.215414 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:36.215847 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:36.216549 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:36.217004 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:36.217433 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:36.221415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:36.243101 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] HTTP exception thrown: Cannot 'attach_volume' instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 while it is in vm_state rescued Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Request method failure captured: Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: POST /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9/os-volume_attachments HTTP/1.1 Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 74 Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGVFBJkPt1N_LAygoJk3npVpvTaiY6oESY7H7eIhb_pE7vIfLRLef0yZ0WO-eOYSAOu29g7tC4almRLKeCmwL68LeS-3Lt-Rocdb4_uhlsXGoOdyOmAFICyobY7aGtCo9lib4xItQIjA7QHpX69KFGmPiDgQ7mjKlhTYlPfqbJSO7CA Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: 84a2eee4447b4eadb79fbdbb874d4476 Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:18:36.244796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: 84a2eee4447b4eadb79fbdbb874d4476 Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-ServerRescueNegativeTestJSON-952056989-project Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 8d154e96376a49918658b0c340c722e9 Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-ServerRescueNegativeTestJSON-952056989-project Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {"volumeAttachment": {"volumeId": "d7c60053-d8f3-41ed-b390-1c59ef1eca80"}} Aug 26 06:18:36.246566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Cannot 'attach_volume' instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 while it is in vm_state rescued Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'server_id': '3647fa12-4de4-4b81-aca1-4687ec0af8f9', 'body': {'volumeAttachment': {'volumeId': 'd7c60053-d8f3-41ed-b390-1c59ef1eca80'}}} Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:18:36.247882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 while it is in vm_state rescued Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:18:36.249314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:18:36.250650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:18:36.250650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:18:36.250650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 while it is in vm_state rescued Aug 26 06:18:36.250650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:18:36.250650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Returning 409 to user: Cannot 'attach_volume' instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 while it is in vm_state rescued {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:18:36.250650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d1e697be-3dde-42e4-a99e-81fb10cc239a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "POST /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046238 Aug 26 06:18:36.254723 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 132/259] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:18:36 2022] POST /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 06:18:36.255988 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3df6c30e-718b-498f-90aa-f370b2eb379d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:36.257257 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3df6c30e-718b-498f-90aa-f370b2eb379d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:36.263154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3df6c30e-718b-498f-90aa-f370b2eb379d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:36.263627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3df6c30e-718b-498f-90aa-f370b2eb379d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:36.264079 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3df6c30e-718b-498f-90aa-f370b2eb379d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:36.264727 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3df6c30e-718b-498f-90aa-f370b2eb379d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:36.265170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3df6c30e-718b-498f-90aa-f370b2eb379d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:36.265584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3df6c30e-718b-498f-90aa-f370b2eb379d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:36.669286 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e2b43994-28cb-4c3c-8d52-0085ff8ad367 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:36.669894 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e2b43994-28cb-4c3c-8d52-0085ff8ad367 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:36.677338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2b43994-28cb-4c3c-8d52-0085ff8ad367 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:36.678055 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2b43994-28cb-4c3c-8d52-0085ff8ad367 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:36.681932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2b43994-28cb-4c3c-8d52-0085ff8ad367 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:36.681932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2b43994-28cb-4c3c-8d52-0085ff8ad367 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:36.681932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2b43994-28cb-4c3c-8d52-0085ff8ad367 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:36.681932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e2b43994-28cb-4c3c-8d52-0085ff8ad367 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:36.746486 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e2b43994-28cb-4c3c-8d52-0085ff8ad367 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:36.754492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e2b43994-28cb-4c3c-8d52-0085ff8ad367 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1266 microversion: 2.1 time: 0.089717 Aug 26 06:18:36.755156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 133/260] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:36 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:36.852765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-03a4df11-1a08-4067-850e-1e180563bc36 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:36.855675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-03a4df11-1a08-4067-850e-1e180563bc36 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:36.866181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03a4df11-1a08-4067-850e-1e180563bc36 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:36.872234 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03a4df11-1a08-4067-850e-1e180563bc36 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:36.873412 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03a4df11-1a08-4067-850e-1e180563bc36 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:36.874225 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03a4df11-1a08-4067-850e-1e180563bc36 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:36.874763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03a4df11-1a08-4067-850e-1e180563bc36 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:36.875220 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03a4df11-1a08-4067-850e-1e180563bc36 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:36.901227 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3df6c30e-718b-498f-90aa-f370b2eb379d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "POST /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9/action" status: 202 len: 0 microversion: 2.1 time: 0.649392 Aug 26 06:18:36.905105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 128/261] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:18:36 2022] POST /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 06:18:36.918296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-dc67610a-537b-4fe9-80a6-b3b88637a87b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:36.919614 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-dc67610a-537b-4fe9-80a6-b3b88637a87b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:36.927757 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc67610a-537b-4fe9-80a6-b3b88637a87b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:36.928489 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc67610a-537b-4fe9-80a6-b3b88637a87b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:36.929267 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc67610a-537b-4fe9-80a6-b3b88637a87b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:36.930371 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc67610a-537b-4fe9-80a6-b3b88637a87b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:36.934073 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc67610a-537b-4fe9-80a6-b3b88637a87b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:36.934073 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc67610a-537b-4fe9-80a6-b3b88637a87b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:37.053884 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-03a4df11-1a08-4067-850e-1e180563bc36 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:37.080754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-03a4df11-1a08-4067-850e-1e180563bc36 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.228522 Aug 26 06:18:37.082791 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 134/262] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:36 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:37.093070 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-653b21e8-0341-49e4-8441-160704233c20 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:37.104262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-653b21e8-0341-49e4-8441-160704233c20 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:37.104935 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-653b21e8-0341-49e4-8441-160704233c20 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:37.105800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-653b21e8-0341-49e4-8441-160704233c20 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:37.172992 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-653b21e8-0341-49e4-8441-160704233c20 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Going to try to stop instance {{(pid=121344) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 06:18:37.684806 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-dc67610a-537b-4fe9-80a6-b3b88637a87b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:37.695664 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-dc67610a-537b-4fe9-80a6-b3b88637a87b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1509 microversion: 2.1 time: 0.789082 Aug 26 06:18:37.697440 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 129/263] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:36 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1509 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:37.703039 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:37.703877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:37.711587 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:37.712302 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:37.712978 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:37.713888 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:37.714526 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:37.715171 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:37.742824 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-653b21e8-0341-49e4-8441-160704233c20 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "POST /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/action" status: 202 len: 0 microversion: 2.1 time: 0.658588 Aug 26 06:18:37.744453 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 135/264] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:18:37 2022] POST /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:18:37.753178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4aa07111-87cb-4616-80fa-e05d0da06d04 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:37.754055 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4aa07111-87cb-4616-80fa-e05d0da06d04 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:37.762205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4aa07111-87cb-4616-80fa-e05d0da06d04 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:37.762922 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4aa07111-87cb-4616-80fa-e05d0da06d04 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:37.763515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4aa07111-87cb-4616-80fa-e05d0da06d04 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:37.770552 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4aa07111-87cb-4616-80fa-e05d0da06d04 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:37.770552 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4aa07111-87cb-4616-80fa-e05d0da06d04 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:37.770552 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4aa07111-87cb-4616-80fa-e05d0da06d04 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:37.797496 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:37.807665 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:37.809454 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:37.810839 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-557c2350-fb3c-419e-8ace-ce9775fdc793 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1340 microversion: 2.20 time: 0.111949 Aug 26 06:18:37.812165 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 130/265] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:37 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1340 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:37.821148 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-11f31d2a-89e7-479f-ab04-b8f6ed67b800 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:37.821759 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-11f31d2a-89e7-479f-ab04-b8f6ed67b800 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:37.829855 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11f31d2a-89e7-479f-ab04-b8f6ed67b800 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:37.831037 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11f31d2a-89e7-479f-ab04-b8f6ed67b800 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:37.831037 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11f31d2a-89e7-479f-ab04-b8f6ed67b800 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:37.831429 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11f31d2a-89e7-479f-ab04-b8f6ed67b800 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:37.831880 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11f31d2a-89e7-479f-ab04-b8f6ed67b800 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:37.832305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11f31d2a-89e7-479f-ab04-b8f6ed67b800 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:37.988180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4aa07111-87cb-4616-80fa-e05d0da06d04 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:37.998755 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4aa07111-87cb-4616-80fa-e05d0da06d04 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.250227 Aug 26 06:18:38.000741 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 136/266] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:37 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:38.033062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-11f31d2a-89e7-479f-ab04-b8f6ed67b800 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:38.046166 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-11f31d2a-89e7-479f-ab04-b8f6ed67b800 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1274 microversion: 2.1 time: 0.232705 Aug 26 06:18:38.046961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 131/267] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:37 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1274 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:38.103932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-82509119-72b6-419c-b792-a25d43b3b94f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:38.104673 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-82509119-72b6-419c-b792-a25d43b3b94f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:38.117815 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-82509119-72b6-419c-b792-a25d43b3b94f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:38.117815 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-82509119-72b6-419c-b792-a25d43b3b94f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:38.118681 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-82509119-72b6-419c-b792-a25d43b3b94f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:38.119576 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-82509119-72b6-419c-b792-a25d43b3b94f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:38.120048 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-82509119-72b6-419c-b792-a25d43b3b94f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:38.122764 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-82509119-72b6-419c-b792-a25d43b3b94f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:38.293795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-82509119-72b6-419c-b792-a25d43b3b94f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:38.297942 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-82509119-72b6-419c-b792-a25d43b3b94f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.198192 Aug 26 06:18:38.298415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 137/268] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:38 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:38.420953 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-38ada33c-7c44-416e-a1d5-f37fc974a45d req-6dd910c7-361f-4a6c-a196-a2fd8c4d661f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a23686-df31-4e61-879f-e1b1eaaef0ea", "name": "network-vif-plugged", "status": "completed", "tag": "8f33f7d7-7e9a-4e62-9cc6-849887fde715"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:38.445870 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-38ada33c-7c44-416e-a1d5-f37fc974a45d req-6dd910c7-361f-4a6c-a196-a2fd8c4d661f service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:38.446368 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-38ada33c-7c44-416e-a1d5-f37fc974a45d req-6dd910c7-361f-4a6c-a196-a2fd8c4d661f service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:38.446869 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-38ada33c-7c44-416e-a1d5-f37fc974a45d req-6dd910c7-361f-4a6c-a196-a2fd8c4d661f service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:38.465590 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-38ada33c-7c44-416e-a1d5-f37fc974a45d req-6dd910c7-361f-4a6c-a196-a2fd8c4d661f service nova] Creating event network-vif-plugged:8f33f7d7-7e9a-4e62-9cc6-849887fde715 for instance 40a23686-df31-4e61-879f-e1b1eaaef0ea on hv-cinder-85391 Aug 26 06:18:38.473781 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-38ada33c-7c44-416e-a1d5-f37fc974a45d req-6dd910c7-361f-4a6c-a196-a2fd8c4d661f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057618 Aug 26 06:18:38.475757 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 132/269] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:18:38.723795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dfd8a871-9fab-417d-b24d-c8b34ecd925c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:38.725587 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-dfd8a871-9fab-417d-b24d-c8b34ecd925c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:38.735401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfd8a871-9fab-417d-b24d-c8b34ecd925c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:38.737066 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfd8a871-9fab-417d-b24d-c8b34ecd925c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:38.740330 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfd8a871-9fab-417d-b24d-c8b34ecd925c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:38.741539 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfd8a871-9fab-417d-b24d-c8b34ecd925c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:38.746049 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfd8a871-9fab-417d-b24d-c8b34ecd925c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:38.746049 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfd8a871-9fab-417d-b24d-c8b34ecd925c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:38.788783 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=4 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:38.861327 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:38.862024 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:38.882982 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:38.883511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:38.884111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:38.884862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:38.885387 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:38.885810 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:38.975344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-dfd8a871-9fab-417d-b24d-c8b34ecd925c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:38.985300 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-dfd8a871-9fab-417d-b24d-c8b34ecd925c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1509 microversion: 2.1 time: 0.266049 Aug 26 06:18:38.994676 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 138/270] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:38 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1509 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:39.022917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:39.036034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:39.038520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-de914afe-aff6-4c91-a192-a3d0c781deb4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:39.039448 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-de914afe-aff6-4c91-a192-a3d0c781deb4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:39.041955 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:39.044483 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-157e81d3-9c91-4692-bea4-701dcd381cdb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1338 microversion: 2.20 time: 0.187163 Aug 26 06:18:39.045785 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 133/271] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:38 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1338 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:39.058441 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de914afe-aff6-4c91-a192-a3d0c781deb4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:39.058954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de914afe-aff6-4c91-a192-a3d0c781deb4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:39.059602 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de914afe-aff6-4c91-a192-a3d0c781deb4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:39.060577 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de914afe-aff6-4c91-a192-a3d0c781deb4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:39.061457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de914afe-aff6-4c91-a192-a3d0c781deb4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:39.062048 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de914afe-aff6-4c91-a192-a3d0c781deb4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:39.075054 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5aa2dd9c-c0cc-4aac-bbc2-5c7e56a40138 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:39.078981 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5aa2dd9c-c0cc-4aac-bbc2-5c7e56a40138 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:39.096808 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5aa2dd9c-c0cc-4aac-bbc2-5c7e56a40138 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:39.097884 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5aa2dd9c-c0cc-4aac-bbc2-5c7e56a40138 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:39.100915 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5aa2dd9c-c0cc-4aac-bbc2-5c7e56a40138 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:39.105399 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5aa2dd9c-c0cc-4aac-bbc2-5c7e56a40138 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:39.106831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5aa2dd9c-c0cc-4aac-bbc2-5c7e56a40138 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:39.108112 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5aa2dd9c-c0cc-4aac-bbc2-5c7e56a40138 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:39.218741 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=16 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:39.275909 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-de914afe-aff6-4c91-a192-a3d0c781deb4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:39.282084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5aa2dd9c-c0cc-4aac-bbc2-5c7e56a40138 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:39.284458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:39.291355 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-de914afe-aff6-4c91-a192-a3d0c781deb4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.257339 Aug 26 06:18:39.291883 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 139/272] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:39 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:39.297156 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5aa2dd9c-c0cc-4aac-bbc2-5c7e56a40138 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1272 microversion: 2.1 time: 0.233301 Aug 26 06:18:39.297901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 134/273] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:39 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:39.327746 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ce9e18da-fb8d-48f9-b948-9c8a2d3f77b1 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:39.333567 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ce9e18da-fb8d-48f9-b948-9c8a2d3f77b1 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:39.337579 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:39.357926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce9e18da-fb8d-48f9-b948-9c8a2d3f77b1 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:39.357926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce9e18da-fb8d-48f9-b948-9c8a2d3f77b1 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:39.357926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce9e18da-fb8d-48f9-b948-9c8a2d3f77b1 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:39.357926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce9e18da-fb8d-48f9-b948-9c8a2d3f77b1 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:39.358742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce9e18da-fb8d-48f9-b948-9c8a2d3f77b1 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:39.358742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ce9e18da-fb8d-48f9-b948-9c8a2d3f77b1 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:39.573014 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ce9e18da-fb8d-48f9-b948-9c8a2d3f77b1 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:39.588080 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ce9e18da-fb8d-48f9-b948-9c8a2d3f77b1 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.270980 Aug 26 06:18:39.599960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 140/274] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:39 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:40.023926 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f8358550-4c68-4c6e-93b9-d3823b3c6067 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:40.023926 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f8358550-4c68-4c6e-93b9-d3823b3c6067 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:40.023926 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:40.028352 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8358550-4c68-4c6e-93b9-d3823b3c6067 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:40.028847 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8358550-4c68-4c6e-93b9-d3823b3c6067 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:40.029437 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8358550-4c68-4c6e-93b9-d3823b3c6067 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:40.031756 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8358550-4c68-4c6e-93b9-d3823b3c6067 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:40.032228 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8358550-4c68-4c6e-93b9-d3823b3c6067 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:40.033654 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8358550-4c68-4c6e-93b9-d3823b3c6067 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:40.085788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:40.086406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:40.103911 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:40.104817 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:40.107060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:40.108068 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:40.109163 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:40.111503 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:40.482983 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:40.494661 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:40.497144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:40.498871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a3dfcca6-9bb6-48ee-98fb-081e08485a9b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1406 microversion: 2.20 time: 0.418653 Aug 26 06:18:40.512200 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 141/275] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:40 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:40.537136 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7ea6087e-0cfb-4585-9ce9-998b7448f959 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:40.541976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7ea6087e-0cfb-4585-9ce9-998b7448f959 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:40.565513 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ea6087e-0cfb-4585-9ce9-998b7448f959 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:40.566560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ea6087e-0cfb-4585-9ce9-998b7448f959 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:40.567471 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ea6087e-0cfb-4585-9ce9-998b7448f959 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:40.569476 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ea6087e-0cfb-4585-9ce9-998b7448f959 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:40.570934 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ea6087e-0cfb-4585-9ce9-998b7448f959 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:40.572061 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ea6087e-0cfb-4585-9ce9-998b7448f959 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:40.643484 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f8358550-4c68-4c6e-93b9-d3823b3c6067 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:40.661438 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f8358550-4c68-4c6e-93b9-d3823b3c6067 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1509 microversion: 2.1 time: 0.652766 Aug 26 06:18:40.663931 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 135/276] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:40 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1509 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:40.673732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-00268466-c3ae-4df0-8c3a-0f8bf6b24e5f tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:40.675256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-00268466-c3ae-4df0-8c3a-0f8bf6b24e5f tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:40.678950 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:40.688641 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00268466-c3ae-4df0-8c3a-0f8bf6b24e5f tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:40.689743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00268466-c3ae-4df0-8c3a-0f8bf6b24e5f tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:40.690507 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00268466-c3ae-4df0-8c3a-0f8bf6b24e5f tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:40.691821 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00268466-c3ae-4df0-8c3a-0f8bf6b24e5f tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:40.692721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00268466-c3ae-4df0-8c3a-0f8bf6b24e5f tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:40.693989 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00268466-c3ae-4df0-8c3a-0f8bf6b24e5f tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:40.840198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7ea6087e-0cfb-4585-9ce9-998b7448f959 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:40.848967 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7ea6087e-0cfb-4585-9ce9-998b7448f959 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.335510 Aug 26 06:18:40.852554 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 142/277] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:40 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:40.863641 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b9049f24-37a3-4d69-a0fc-1c4dbe5ff169 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:40.867535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b9049f24-37a3-4d69-a0fc-1c4dbe5ff169 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:40.880507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9049f24-37a3-4d69-a0fc-1c4dbe5ff169 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:40.881532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9049f24-37a3-4d69-a0fc-1c4dbe5ff169 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:40.882264 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9049f24-37a3-4d69-a0fc-1c4dbe5ff169 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:40.883944 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9049f24-37a3-4d69-a0fc-1c4dbe5ff169 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:40.884696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9049f24-37a3-4d69-a0fc-1c4dbe5ff169 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:40.885431 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9049f24-37a3-4d69-a0fc-1c4dbe5ff169 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:41.037541 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-00268466-c3ae-4df0-8c3a-0f8bf6b24e5f tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:41.045180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-00268466-c3ae-4df0-8c3a-0f8bf6b24e5f tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1314 microversion: 2.1 time: 0.379381 Aug 26 06:18:41.059077 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 136/278] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:40 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:41.206525 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b9049f24-37a3-4d69-a0fc-1c4dbe5ff169 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:41.215458 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b9049f24-37a3-4d69-a0fc-1c4dbe5ff169 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.360358 Aug 26 06:18:41.230048 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 143/279] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:40 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:41.526287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:41.527074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:41.533191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:41.533754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:41.534280 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:41.535084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:41.535610 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:41.536104 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:41.685984 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ed33df6b-a2cd-4285-9bd2-6ea83ade5748 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:41.687373 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ed33df6b-a2cd-4285-9bd2-6ea83ade5748 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:41.694989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed33df6b-a2cd-4285-9bd2-6ea83ade5748 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:41.696022 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed33df6b-a2cd-4285-9bd2-6ea83ade5748 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:41.696781 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed33df6b-a2cd-4285-9bd2-6ea83ade5748 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:41.698058 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed33df6b-a2cd-4285-9bd2-6ea83ade5748 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:41.698718 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed33df6b-a2cd-4285-9bd2-6ea83ade5748 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:41.699453 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed33df6b-a2cd-4285-9bd2-6ea83ade5748 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:41.822678 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:41.837201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:41.851296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:41.854116 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d7387c50-cafe-40c3-ae02-15e5ca0964a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1406 microversion: 2.20 time: 0.332553 Aug 26 06:18:41.857777 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 137/280] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:41 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:41.859339 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ed33df6b-a2cd-4285-9bd2-6ea83ade5748 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:41.868839 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-526541a6-d764-4a2e-8231-d312d3086a8f req-1bfeb20a-1bba-4581-aa67-728c5015b16a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c", "tag": "3b7fc810-cb09-42a2-a246-9a1fd1d7d061"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:41.868999 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ed33df6b-a2cd-4285-9bd2-6ea83ade5748 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1515 microversion: 2.1 time: 0.187001 Aug 26 06:18:41.869479 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 144/281] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:41 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:41.891731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a4387074-7d41-4316-bb37-7ee149cdeb73 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:41.895844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a4387074-7d41-4316-bb37-7ee149cdeb73 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:41.902259 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4387074-7d41-4316-bb37-7ee149cdeb73 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:41.902857 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4387074-7d41-4316-bb37-7ee149cdeb73 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:41.916761 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4387074-7d41-4316-bb37-7ee149cdeb73 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:41.918864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4387074-7d41-4316-bb37-7ee149cdeb73 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:41.921470 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4387074-7d41-4316-bb37-7ee149cdeb73 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:41.922633 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4387074-7d41-4316-bb37-7ee149cdeb73 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:41.923477 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-526541a6-d764-4a2e-8231-d312d3086a8f req-1bfeb20a-1bba-4581-aa67-728c5015b16a service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:41.923975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-526541a6-d764-4a2e-8231-d312d3086a8f req-1bfeb20a-1bba-4581-aa67-728c5015b16a service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:41.924403 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-526541a6-d764-4a2e-8231-d312d3086a8f req-1bfeb20a-1bba-4581-aa67-728c5015b16a service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:41.950311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-526541a6-d764-4a2e-8231-d312d3086a8f req-1bfeb20a-1bba-4581-aa67-728c5015b16a service nova] Creating event network-changed:3b7fc810-cb09-42a2-a246-9a1fd1d7d061 for instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c on hv-cinder-85391 Aug 26 06:18:41.953895 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-526541a6-d764-4a2e-8231-d312d3086a8f req-1bfeb20a-1bba-4581-aa67-728c5015b16a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094463 Aug 26 06:18:41.954518 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 138/282] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:18:42.070201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3daae722-6117-4eb9-85b3-5d611f2cf281 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:42.072203 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3daae722-6117-4eb9-85b3-5d611f2cf281 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:42.090954 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3daae722-6117-4eb9-85b3-5d611f2cf281 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:42.091702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3daae722-6117-4eb9-85b3-5d611f2cf281 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:42.092298 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3daae722-6117-4eb9-85b3-5d611f2cf281 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:42.093185 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3daae722-6117-4eb9-85b3-5d611f2cf281 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:42.093786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3daae722-6117-4eb9-85b3-5d611f2cf281 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:42.094528 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3daae722-6117-4eb9-85b3-5d611f2cf281 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:42.162672 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a4387074-7d41-4316-bb37-7ee149cdeb73 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:42.176287 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a4387074-7d41-4316-bb37-7ee149cdeb73 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.300663 Aug 26 06:18:42.187088 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 145/283] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:41 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:42.225906 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=20 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:42.238251 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-72a4d238-1299-4d93-b86b-94aae2017a77 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:42.239840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-72a4d238-1299-4d93-b86b-94aae2017a77 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:42.246112 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a4d238-1299-4d93-b86b-94aae2017a77 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:42.246935 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a4d238-1299-4d93-b86b-94aae2017a77 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:42.247368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a4d238-1299-4d93-b86b-94aae2017a77 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:42.248085 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a4d238-1299-4d93-b86b-94aae2017a77 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:42.248515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a4d238-1299-4d93-b86b-94aae2017a77 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:42.249135 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a4d238-1299-4d93-b86b-94aae2017a77 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:42.420758 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-72a4d238-1299-4d93-b86b-94aae2017a77 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:42.452735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-72a4d238-1299-4d93-b86b-94aae2017a77 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1318 microversion: 2.1 time: 0.219026 Aug 26 06:18:42.454463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 146/284] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:42 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:42.506317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3daae722-6117-4eb9-85b3-5d611f2cf281 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:42.514967 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3daae722-6117-4eb9-85b3-5d611f2cf281 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1314 microversion: 2.1 time: 0.450602 Aug 26 06:18:42.515553 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 139/285] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:42 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:42.882508 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:42.883218 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:42.889979 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:42.890571 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:42.891740 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:42.892649 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:42.893116 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:42.893549 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:43.057502 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:43.070087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:43.079233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:43.079233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-aecef925-0596-48ac-8cb6-7d87a88aea01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1406 microversion: 2.20 time: 0.195140 Aug 26 06:18:43.079233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 147/286] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:42 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:43.200603 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f671cd67-9b6e-493b-88b9-b1f1b69e675a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:43.202043 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f671cd67-9b6e-493b-88b9-b1f1b69e675a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:43.211868 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f671cd67-9b6e-493b-88b9-b1f1b69e675a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:43.212065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f671cd67-9b6e-493b-88b9-b1f1b69e675a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:43.212606 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f671cd67-9b6e-493b-88b9-b1f1b69e675a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:43.213430 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f671cd67-9b6e-493b-88b9-b1f1b69e675a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:43.213950 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f671cd67-9b6e-493b-88b9-b1f1b69e675a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:43.214470 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f671cd67-9b6e-493b-88b9-b1f1b69e675a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:43.492694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0c9bc72c-4f1f-4bc9-a91b-8f252b17335f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:43.493737 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0c9bc72c-4f1f-4bc9-a91b-8f252b17335f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:43.494426 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f671cd67-9b6e-493b-88b9-b1f1b69e675a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:43.527806 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f671cd67-9b6e-493b-88b9-b1f1b69e675a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.331819 Aug 26 06:18:43.529135 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 140/287] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:43 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:43.542225 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f3ef0018-d322-4700-aa5f-77c3ff1bc7c2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:43.548083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f3ef0018-d322-4700-aa5f-77c3ff1bc7c2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:43.548696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c9bc72c-4f1f-4bc9-a91b-8f252b17335f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:43.552238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c9bc72c-4f1f-4bc9-a91b-8f252b17335f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:43.552864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c9bc72c-4f1f-4bc9-a91b-8f252b17335f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:43.555892 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c9bc72c-4f1f-4bc9-a91b-8f252b17335f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:43.556085 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f3ef0018-d322-4700-aa5f-77c3ff1bc7c2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:43.559377 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c9bc72c-4f1f-4bc9-a91b-8f252b17335f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:43.559520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f3ef0018-d322-4700-aa5f-77c3ff1bc7c2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:43.559520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f3ef0018-d322-4700-aa5f-77c3ff1bc7c2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:43.559520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f3ef0018-d322-4700-aa5f-77c3ff1bc7c2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:43.559813 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c9bc72c-4f1f-4bc9-a91b-8f252b17335f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:43.559962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f3ef0018-d322-4700-aa5f-77c3ff1bc7c2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:43.559962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f3ef0018-d322-4700-aa5f-77c3ff1bc7c2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:43.747405 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f3ef0018-d322-4700-aa5f-77c3ff1bc7c2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:43.758657 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0c9bc72c-4f1f-4bc9-a91b-8f252b17335f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:43.759888 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f3ef0018-d322-4700-aa5f-77c3ff1bc7c2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1314 microversion: 2.1 time: 0.221986 Aug 26 06:18:43.773619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 141/288] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:43 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:43.773827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0c9bc72c-4f1f-4bc9-a91b-8f252b17335f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1506 microversion: 2.1 time: 0.287911 Aug 26 06:18:43.773827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 148/289] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:43 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:43.982234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-4e3e8fc9-d45a-4981-8407-16ae40e02c0f req-949e0aca-5e09-46c0-8fb3-b7efc8690768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4000095-117a-48e3-9606-2bd4a61ae04e", "tag": "55aba2b1-9455-4767-bf2b-537bec16837d"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:44.000838 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-4e3e8fc9-d45a-4981-8407-16ae40e02c0f req-949e0aca-5e09-46c0-8fb3-b7efc8690768 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:44.001467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-4e3e8fc9-d45a-4981-8407-16ae40e02c0f req-949e0aca-5e09-46c0-8fb3-b7efc8690768 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:44.001919 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-4e3e8fc9-d45a-4981-8407-16ae40e02c0f req-949e0aca-5e09-46c0-8fb3-b7efc8690768 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:44.017792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-4e3e8fc9-d45a-4981-8407-16ae40e02c0f req-949e0aca-5e09-46c0-8fb3-b7efc8690768 service nova] Creating event network-changed:55aba2b1-9455-4767-bf2b-537bec16837d for instance a4000095-117a-48e3-9606-2bd4a61ae04e on hv-cinder-85391 Aug 26 06:18:44.024002 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-4e3e8fc9-d45a-4981-8407-16ae40e02c0f req-949e0aca-5e09-46c0-8fb3-b7efc8690768 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050997 Aug 26 06:18:44.024857 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 142/290] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:18:44.099577 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:44.100349 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:44.107207 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:44.107717 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:44.108351 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:44.109417 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:44.110423 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:44.111105 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:44.564584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ea1c748c-5481-4be1-9e09-8c08e79e7a43 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:44.565266 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ea1c748c-5481-4be1-9e09-8c08e79e7a43 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:44.572105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ea1c748c-5481-4be1-9e09-8c08e79e7a43 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:44.572458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ea1c748c-5481-4be1-9e09-8c08e79e7a43 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:44.573063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ea1c748c-5481-4be1-9e09-8c08e79e7a43 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:44.574088 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ea1c748c-5481-4be1-9e09-8c08e79e7a43 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:44.574539 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ea1c748c-5481-4be1-9e09-8c08e79e7a43 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:44.575311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ea1c748c-5481-4be1-9e09-8c08e79e7a43 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:44.578596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:44.590181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:44.592056 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:44.603210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-795da64f-0650-4fe0-9d4c-8637cbedd909 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1406 microversion: 2.20 time: 0.507610 Aug 26 06:18:44.603959 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 149/291] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:44 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:44.728616 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ea1c748c-5481-4be1-9e09-8c08e79e7a43 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:44.739012 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ea1c748c-5481-4be1-9e09-8c08e79e7a43 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.178414 Aug 26 06:18:44.739600 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 143/292] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:44 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:44.781362 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e97b6310-0f17-425c-a645-12db53c14aa9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:44.781967 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e97b6310-0f17-425c-a645-12db53c14aa9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:44.788918 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e97b6310-0f17-425c-a645-12db53c14aa9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:44.789405 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e97b6310-0f17-425c-a645-12db53c14aa9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:44.789841 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e97b6310-0f17-425c-a645-12db53c14aa9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:44.790833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e97b6310-0f17-425c-a645-12db53c14aa9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:44.791290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e97b6310-0f17-425c-a645-12db53c14aa9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:44.791721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e97b6310-0f17-425c-a645-12db53c14aa9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:44.973760 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e97b6310-0f17-425c-a645-12db53c14aa9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:44.984796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e97b6310-0f17-425c-a645-12db53c14aa9 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1314 microversion: 2.1 time: 0.207237 Aug 26 06:18:44.985358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 150/293] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:44 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:45.466268 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7ca779ff-e8be-4230-b5fd-f02725ea62df tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Action: 'create', calling method: .version_select at 0x7f2f091d63a0>, body: {"keypair": {"name": "tempest-keypair-896541118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFDoerRJdRIzYuAcBaFkFwWRbWKXoZPBQ70y/V5Dh8XuDkLxm5JK3VlxGrRck6snleUN6HD+mLPu3MmA0meggCFzaBAQJYIEuoCi/n/fJyDFwDv66Tm0Sj684UIIFXiWA=="}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:45.486262 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-7ca779ff-e8be-4230-b5fd-f02725ea62df tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Getting quotas for project 84a2eee4447b4eadb79fbdbb874d4476. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:18:45.492417 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-7ca779ff-e8be-4230-b5fd-f02725ea62df tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Getting quotas for user 8d154e96376a49918658b0c340c722e9 and project 84a2eee4447b4eadb79fbdbb874d4476. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:18:45.632993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:45.635003 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:45.654866 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:45.655631 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:45.656333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:45.667910 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:45.667910 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:45.667910 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:45.723897 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7ca779ff-e8be-4230-b5fd-f02725ea62df tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.261663 Aug 26 06:18:45.725252 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 144/294] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 06:18:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:18:45.764091 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-89848909-6733-4839-a172-dda93d21b272 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:45.765901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-89848909-6733-4839-a172-dda93d21b272 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:45.783344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89848909-6733-4839-a172-dda93d21b272 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:45.783836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89848909-6733-4839-a172-dda93d21b272 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:45.784453 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89848909-6733-4839-a172-dda93d21b272 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:45.785169 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89848909-6733-4839-a172-dda93d21b272 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:45.785621 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89848909-6733-4839-a172-dda93d21b272 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:45.786041 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89848909-6733-4839-a172-dda93d21b272 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:45.861117 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:45.878709 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:45.882479 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:45.883061 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2cf4daa4-bbe3-43e9-be45-addd69c2ff2e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1406 microversion: 2.20 time: 0.254824 Aug 26 06:18:45.884290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 151/295] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:45 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:46.014111 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2086ba14-0d0f-4cac-b381-dde4871c61ee tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:46.016163 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2086ba14-0d0f-4cac-b381-dde4871c61ee tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:46.031793 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2086ba14-0d0f-4cac-b381-dde4871c61ee tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:46.038742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2086ba14-0d0f-4cac-b381-dde4871c61ee tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:46.038742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2086ba14-0d0f-4cac-b381-dde4871c61ee tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:46.038742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2086ba14-0d0f-4cac-b381-dde4871c61ee tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:46.041472 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2086ba14-0d0f-4cac-b381-dde4871c61ee tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:46.043194 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2086ba14-0d0f-4cac-b381-dde4871c61ee tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:46.400699 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2086ba14-0d0f-4cac-b381-dde4871c61ee tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:46.421961 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2086ba14-0d0f-4cac-b381-dde4871c61ee tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1314 microversion: 2.1 time: 0.414752 Aug 26 06:18:46.428053 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 152/296] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:46 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:46.619989 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-89848909-6733-4839-a172-dda93d21b272 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:46.633184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-89848909-6733-4839-a172-dda93d21b272 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.875582 Aug 26 06:18:46.636641 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 145/297] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:45 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:46.907591 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:46.908191 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:46.922430 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:46.922944 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:46.923378 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:46.924074 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:46.924528 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:46.924945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:46.976933 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:47.104354 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:47.113367 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:47.115439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:47.116575 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-21c0b423-8af0-47b7-ad97-30a202c08450 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1406 microversion: 2.20 time: 0.214753 Aug 26 06:18:47.117137 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 153/298] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:46 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:47.446614 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5ded08e6-3b6a-4727-8b0b-3cf512e05ad3 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:47.455168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5ded08e6-3b6a-4727-8b0b-3cf512e05ad3 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:47.455168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5ded08e6-3b6a-4727-8b0b-3cf512e05ad3 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:47.455168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5ded08e6-3b6a-4727-8b0b-3cf512e05ad3 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:47.455168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5ded08e6-3b6a-4727-8b0b-3cf512e05ad3 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:47.455572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5ded08e6-3b6a-4727-8b0b-3cf512e05ad3 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:47.456117 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5ded08e6-3b6a-4727-8b0b-3cf512e05ad3 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:47.456538 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5ded08e6-3b6a-4727-8b0b-3cf512e05ad3 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:47.643713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5ded08e6-3b6a-4727-8b0b-3cf512e05ad3 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:47.660439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0984496e-dc46-4b78-8071-33e4e580d95d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:47.661417 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0984496e-dc46-4b78-8071-33e4e580d95d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:47.673412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5ded08e6-3b6a-4727-8b0b-3cf512e05ad3 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1314 microversion: 2.1 time: 0.231265 Aug 26 06:18:47.682705 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 146/299] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:47 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:47.690719 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0984496e-dc46-4b78-8071-33e4e580d95d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:47.692584 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0984496e-dc46-4b78-8071-33e4e580d95d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:47.692584 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0984496e-dc46-4b78-8071-33e4e580d95d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:47.693943 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0984496e-dc46-4b78-8071-33e4e580d95d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:47.694658 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0984496e-dc46-4b78-8071-33e4e580d95d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:47.695208 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0984496e-dc46-4b78-8071-33e4e580d95d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:47.907448 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0984496e-dc46-4b78-8071-33e4e580d95d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:47.918724 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0984496e-dc46-4b78-8071-33e4e580d95d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.264342 Aug 26 06:18:47.935382 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 154/300] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:47 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:48.140661 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:48.141345 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:48.149026 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:48.149643 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:48.150275 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:48.151221 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:48.151683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:48.152179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:48.493812 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-6b286116-3328-4b75-8e4b-2bdd6979c39d req-29bc00d4-3db0-4ad8-83eb-7f578ed2b6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c", "name": "network-vif-plugged", "status": "completed", "tag": "3b7fc810-cb09-42a2-a246-9a1fd1d7d061"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:48.503994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-6b286116-3328-4b75-8e4b-2bdd6979c39d req-29bc00d4-3db0-4ad8-83eb-7f578ed2b6b7 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:48.509896 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-6b286116-3328-4b75-8e4b-2bdd6979c39d req-29bc00d4-3db0-4ad8-83eb-7f578ed2b6b7 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:48.509896 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-6b286116-3328-4b75-8e4b-2bdd6979c39d req-29bc00d4-3db0-4ad8-83eb-7f578ed2b6b7 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:48.518536 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-6b286116-3328-4b75-8e4b-2bdd6979c39d req-29bc00d4-3db0-4ad8-83eb-7f578ed2b6b7 service nova] Creating event network-vif-plugged:3b7fc810-cb09-42a2-a246-9a1fd1d7d061 for instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c on hv-cinder-85391 Aug 26 06:18:48.525369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-6b286116-3328-4b75-8e4b-2bdd6979c39d req-29bc00d4-3db0-4ad8-83eb-7f578ed2b6b7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037941 Aug 26 06:18:48.526009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 155/301] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:18:48.539858 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:48.555145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:48.557992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:48.559996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-11e8512f-0084-47e7-bcca-92581b5085b3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1406 microversion: 2.20 time: 0.423258 Aug 26 06:18:48.560946 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 147/302] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:48 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:48.700125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c474e55b-1777-484d-8251-bd0164885f2c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:48.701481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c474e55b-1777-484d-8251-bd0164885f2c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:48.709172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c474e55b-1777-484d-8251-bd0164885f2c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:48.709864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c474e55b-1777-484d-8251-bd0164885f2c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:48.710311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c474e55b-1777-484d-8251-bd0164885f2c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:48.711074 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c474e55b-1777-484d-8251-bd0164885f2c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:48.711537 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c474e55b-1777-484d-8251-bd0164885f2c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:48.711970 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c474e55b-1777-484d-8251-bd0164885f2c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:48.945861 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c474e55b-1777-484d-8251-bd0164885f2c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:48.955823 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c474e55b-1777-484d-8251-bd0164885f2c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1314 microversion: 2.1 time: 0.262511 Aug 26 06:18:48.956691 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 156/303] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:48 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:48.974597 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-174d2ab6-c512-471a-890a-9a12bee4540e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:48.975714 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-174d2ab6-c512-471a-890a-9a12bee4540e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:48.982704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-174d2ab6-c512-471a-890a-9a12bee4540e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:48.983531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-174d2ab6-c512-471a-890a-9a12bee4540e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:48.984035 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-174d2ab6-c512-471a-890a-9a12bee4540e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:48.984835 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-174d2ab6-c512-471a-890a-9a12bee4540e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:48.985523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-174d2ab6-c512-471a-890a-9a12bee4540e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:48.985955 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-174d2ab6-c512-471a-890a-9a12bee4540e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:49.213863 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-174d2ab6-c512-471a-890a-9a12bee4540e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:49.223070 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-174d2ab6-c512-471a-890a-9a12bee4540e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.274827 Aug 26 06:18:49.223754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 148/304] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:48 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:49.605226 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:49.606223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:49.613774 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:49.614574 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:49.616107 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:49.617525 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:49.618100 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:49.618611 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:49.851598 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:49.866094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:49.867835 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:49.868987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7dfcf37c-6897-4595-91e8-f3b813a465f5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1406 microversion: 2.20 time: 0.268743 Aug 26 06:18:49.869707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 157/305] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:49 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:49.994328 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ade62481-cc1d-4582-9b94-b2f3fd07673d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:49.994328 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ade62481-cc1d-4582-9b94-b2f3fd07673d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:49.997292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ade62481-cc1d-4582-9b94-b2f3fd07673d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:49.998313 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ade62481-cc1d-4582-9b94-b2f3fd07673d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:49.999144 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ade62481-cc1d-4582-9b94-b2f3fd07673d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:49.999921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ade62481-cc1d-4582-9b94-b2f3fd07673d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:50.000442 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ade62481-cc1d-4582-9b94-b2f3fd07673d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:50.000940 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ade62481-cc1d-4582-9b94-b2f3fd07673d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:50.166746 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ade62481-cc1d-4582-9b94-b2f3fd07673d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:50.175618 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ade62481-cc1d-4582-9b94-b2f3fd07673d tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1314 microversion: 2.1 time: 0.193658 Aug 26 06:18:50.178559 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 149/306] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:49 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:50.244585 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6fbef063-5896-4a45-ab9f-ce1b06bf1a83 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:50.245449 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6fbef063-5896-4a45-ab9f-ce1b06bf1a83 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:50.251742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6fbef063-5896-4a45-ab9f-ce1b06bf1a83 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:50.252233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6fbef063-5896-4a45-ab9f-ce1b06bf1a83 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:50.252676 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6fbef063-5896-4a45-ab9f-ce1b06bf1a83 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:50.253406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6fbef063-5896-4a45-ab9f-ce1b06bf1a83 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:50.254183 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6fbef063-5896-4a45-ab9f-ce1b06bf1a83 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:50.254987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6fbef063-5896-4a45-ab9f-ce1b06bf1a83 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:50.414589 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6fbef063-5896-4a45-ab9f-ce1b06bf1a83 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:50.423981 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6fbef063-5896-4a45-ab9f-ce1b06bf1a83 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.183274 Aug 26 06:18:50.424652 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 158/307] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:50 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:50.542073 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-47b28f3e-ba5f-4aac-8397-d8a27954adaa req-1677104b-3268-42f1-a388-9acb96cccc08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4000095-117a-48e3-9606-2bd4a61ae04e", "name": "network-vif-plugged", "status": "completed", "tag": "55aba2b1-9455-4767-bf2b-537bec16837d"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:50.553502 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-47b28f3e-ba5f-4aac-8397-d8a27954adaa req-1677104b-3268-42f1-a388-9acb96cccc08 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:50.554181 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-47b28f3e-ba5f-4aac-8397-d8a27954adaa req-1677104b-3268-42f1-a388-9acb96cccc08 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:50.554877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-47b28f3e-ba5f-4aac-8397-d8a27954adaa req-1677104b-3268-42f1-a388-9acb96cccc08 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:50.571709 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-47b28f3e-ba5f-4aac-8397-d8a27954adaa req-1677104b-3268-42f1-a388-9acb96cccc08 service nova] Creating event network-vif-plugged:55aba2b1-9455-4767-bf2b-537bec16837d for instance a4000095-117a-48e3-9606-2bd4a61ae04e on hv-cinder-85391 Aug 26 06:18:50.578688 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-47b28f3e-ba5f-4aac-8397-d8a27954adaa req-1677104b-3268-42f1-a388-9acb96cccc08 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041815 Aug 26 06:18:50.583005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 150/308] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:18:50.616854 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-145490887", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4400288-0fd6-4a35-b08d-549e7c7c455e"}], "security_groups": [{"name": "tempest-securitygroup--1935391258"}], "key_name": "tempest-keypair-896541118", "user_data": "}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:50.894169 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:50.894895 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:50.903098 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:50.903585 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:50.904035 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:50.905386 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:50.905849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:50.907028 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:51.088256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:51.102132 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:51.105239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:51.106701 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8f7b8238-2bbc-413c-969d-caff40b978f3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1406 microversion: 2.20 time: 0.217608 Aug 26 06:18:51.107406 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 151/309] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:50 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:18:51.199939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f5b803d0-2a92-4c53-85c2-0ea5c12b3aef tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:51.200550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f5b803d0-2a92-4c53-85c2-0ea5c12b3aef tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:51.208028 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f5b803d0-2a92-4c53-85c2-0ea5c12b3aef tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:51.208636 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f5b803d0-2a92-4c53-85c2-0ea5c12b3aef tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:51.209185 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f5b803d0-2a92-4c53-85c2-0ea5c12b3aef tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:51.209994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f5b803d0-2a92-4c53-85c2-0ea5c12b3aef tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:51.210460 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f5b803d0-2a92-4c53-85c2-0ea5c12b3aef tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:51.211009 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f5b803d0-2a92-4c53-85c2-0ea5c12b3aef tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:51.368844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f5b803d0-2a92-4c53-85c2-0ea5c12b3aef tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:51.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f5b803d0-2a92-4c53-85c2-0ea5c12b3aef tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1314 microversion: 2.1 time: 0.183543 Aug 26 06:18:51.380171 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 152/310] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:51 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:51.462853 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-eaa95a6d-8096-4600-9609-bafcd399ea63 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:51.464292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-eaa95a6d-8096-4600-9609-bafcd399ea63 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:51.473128 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaa95a6d-8096-4600-9609-bafcd399ea63 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:51.473793 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaa95a6d-8096-4600-9609-bafcd399ea63 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:51.475114 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaa95a6d-8096-4600-9609-bafcd399ea63 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:51.478877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaa95a6d-8096-4600-9609-bafcd399ea63 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:51.478877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaa95a6d-8096-4600-9609-bafcd399ea63 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:51.478877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaa95a6d-8096-4600-9609-bafcd399ea63 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:51.685886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-eaa95a6d-8096-4600-9609-bafcd399ea63 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:51.698560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-eaa95a6d-8096-4600-9609-bafcd399ea63 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.252688 Aug 26 06:18:51.699479 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 153/311] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:51 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:52.136639 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:52.137603 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:52.147376 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:52.153924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:52.153924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:52.153924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:52.153924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:52.154452 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:52.303543 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:52.313226 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:52.314677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:52.315937 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-aeb547a0-826e-45fe-adbe-dabfb75ccd16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1598 microversion: 2.20 time: 0.189382 Aug 26 06:18:52.316481 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 154/312] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:18:52 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1598 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:18:52.341520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b39600f5-21e0-4db1-99cd-c25003d88120 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:52.341917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b39600f5-21e0-4db1-99cd-c25003d88120 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:52.348399 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39600f5-21e0-4db1-99cd-c25003d88120 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:52.349005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39600f5-21e0-4db1-99cd-c25003d88120 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:52.350572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39600f5-21e0-4db1-99cd-c25003d88120 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:52.351354 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39600f5-21e0-4db1-99cd-c25003d88120 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:52.351800 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39600f5-21e0-4db1-99cd-c25003d88120 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:52.352259 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39600f5-21e0-4db1-99cd-c25003d88120 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:52.443694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b39600f5-21e0-4db1-99cd-c25003d88120 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106073 Aug 26 06:18:52.444345 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 155/313] 10.222.0.40 () {60 vars in 1316 bytes} [Fri Aug 26 06:18:52 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 06:18:52.448903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-42ce987b-c94d-47bd-856d-93e6e7cf1be2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:52.449502 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-42ce987b-c94d-47bd-856d-93e6e7cf1be2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:52.456035 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42ce987b-c94d-47bd-856d-93e6e7cf1be2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:52.456629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42ce987b-c94d-47bd-856d-93e6e7cf1be2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:52.457058 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42ce987b-c94d-47bd-856d-93e6e7cf1be2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:52.457752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42ce987b-c94d-47bd-856d-93e6e7cf1be2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:52.458878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42ce987b-c94d-47bd-856d-93e6e7cf1be2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:52.459484 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42ce987b-c94d-47bd-856d-93e6e7cf1be2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:52.649916 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-42ce987b-c94d-47bd-856d-93e6e7cf1be2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:52.659763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-42ce987b-c94d-47bd-856d-93e6e7cf1be2 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1314 microversion: 2.1 time: 0.214283 Aug 26 06:18:52.660450 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 156/314] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:52 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:52.732396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b0194c38-9c1d-4395-9e43-c86e2f0b4b97 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:52.733425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b0194c38-9c1d-4395-9e43-c86e2f0b4b97 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:52.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=100 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:52.758008 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0194c38-9c1d-4395-9e43-c86e2f0b4b97 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:52.758844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0194c38-9c1d-4395-9e43-c86e2f0b4b97 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:52.762126 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0194c38-9c1d-4395-9e43-c86e2f0b4b97 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:52.763436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0194c38-9c1d-4395-9e43-c86e2f0b4b97 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:52.764259 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0194c38-9c1d-4395-9e43-c86e2f0b4b97 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:52.764998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0194c38-9c1d-4395-9e43-c86e2f0b4b97 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:52.992751 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b0194c38-9c1d-4395-9e43-c86e2f0b4b97 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:53.008412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b0194c38-9c1d-4395-9e43-c86e2f0b4b97 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.288400 Aug 26 06:18:53.009482 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 157/315] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:52 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:53.694277 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-696510af-9611-4d97-bde1-2b521c069373 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:53.696202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-696510af-9611-4d97-bde1-2b521c069373 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:53.705009 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-696510af-9611-4d97-bde1-2b521c069373 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:53.705983 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-696510af-9611-4d97-bde1-2b521c069373 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:53.783704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-696510af-9611-4d97-bde1-2b521c069373 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:53.783704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-696510af-9611-4d97-bde1-2b521c069373 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:53.783704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-696510af-9611-4d97-bde1-2b521c069373 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:53.783704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-696510af-9611-4d97-bde1-2b521c069373 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:53.885868 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-696510af-9611-4d97-bde1-2b521c069373 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:53.928136 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-696510af-9611-4d97-bde1-2b521c069373 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1314 microversion: 2.1 time: 0.238266 Aug 26 06:18:53.928765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 158/316] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:53 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:53.967245 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-cf57d426-43e8-4b64-b47c-939fb78d33ed req-ff8b303c-9cdc-4438-b7b7-624cb9b80a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c", "tag": "3b7fc810-cb09-42a2-a246-9a1fd1d7d061"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:18:53.979242 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-cf57d426-43e8-4b64-b47c-939fb78d33ed req-ff8b303c-9cdc-4438-b7b7-624cb9b80a1a service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:53.979825 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-cf57d426-43e8-4b64-b47c-939fb78d33ed req-ff8b303c-9cdc-4438-b7b7-624cb9b80a1a service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:53.980319 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-cf57d426-43e8-4b64-b47c-939fb78d33ed req-ff8b303c-9cdc-4438-b7b7-624cb9b80a1a service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:53.996082 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-cf57d426-43e8-4b64-b47c-939fb78d33ed req-ff8b303c-9cdc-4438-b7b7-624cb9b80a1a service nova] Creating event network-changed:3b7fc810-cb09-42a2-a246-9a1fd1d7d061 for instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c on hv-cinder-85391 Aug 26 06:18:54.025709 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-cf57d426-43e8-4b64-b47c-939fb78d33ed req-ff8b303c-9cdc-4438-b7b7-624cb9b80a1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038857 Aug 26 06:18:54.025709 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 159/317] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:18:54.039343 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f26afd4b-0157-449d-8b26-794971290d89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:54.040745 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f26afd4b-0157-449d-8b26-794971290d89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:54.050309 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26afd4b-0157-449d-8b26-794971290d89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:54.051177 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26afd4b-0157-449d-8b26-794971290d89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:54.051960 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26afd4b-0157-449d-8b26-794971290d89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:54.053312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26afd4b-0157-449d-8b26-794971290d89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:54.054096 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26afd4b-0157-449d-8b26-794971290d89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:54.055119 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26afd4b-0157-449d-8b26-794971290d89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:54.358506 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f26afd4b-0157-449d-8b26-794971290d89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:54.367624 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f26afd4b-0157-449d-8b26-794971290d89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.335491 Aug 26 06:18:54.368562 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 160/318] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:54 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:54.967990 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0890249c-6ddb-4fac-ae38-0e73f878eeab tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:54.980956 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0890249c-6ddb-4fac-ae38-0e73f878eeab tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:54.987517 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0890249c-6ddb-4fac-ae38-0e73f878eeab tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:54.988323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0890249c-6ddb-4fac-ae38-0e73f878eeab tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:54.989011 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0890249c-6ddb-4fac-ae38-0e73f878eeab tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:54.990748 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0890249c-6ddb-4fac-ae38-0e73f878eeab tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:54.991527 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0890249c-6ddb-4fac-ae38-0e73f878eeab tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:54.992225 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0890249c-6ddb-4fac-ae38-0e73f878eeab tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:55.222243 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0890249c-6ddb-4fac-ae38-0e73f878eeab tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:55.234504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0890249c-6ddb-4fac-ae38-0e73f878eeab tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1464 microversion: 2.1 time: 0.286088 Aug 26 06:18:55.235452 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 161/319] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:54 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1464 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:55.312832 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0eddc34a-b0d6-4bfa-b0e6-d3d8d0991977 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:55.313828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0eddc34a-b0d6-4bfa-b0e6-d3d8d0991977 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:55.326723 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0eddc34a-b0d6-4bfa-b0e6-d3d8d0991977 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:55.327561 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0eddc34a-b0d6-4bfa-b0e6-d3d8d0991977 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:55.328303 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0eddc34a-b0d6-4bfa-b0e6-d3d8d0991977 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:55.329461 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0eddc34a-b0d6-4bfa-b0e6-d3d8d0991977 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:55.330255 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0eddc34a-b0d6-4bfa-b0e6-d3d8d0991977 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:55.331009 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0eddc34a-b0d6-4bfa-b0e6-d3d8d0991977 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:55.374966 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0eddc34a-b0d6-4bfa-b0e6-d3d8d0991977 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Going to try to terminate instance {{(pid=121343) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:18:56.060342 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0eddc34a-b0d6-4bfa-b0e6-d3d8d0991977 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 204 len: 0 microversion: 2.1 time: 0.757502 Aug 26 06:18:56.061225 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 162/320] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:18:55 2022] DELETE /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 0 bytes in 760 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 06:18:56.068393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-080ad071-57b3-4c74-80d5-a923d81dd4d8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:56.069098 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-080ad071-57b3-4c74-80d5-a923d81dd4d8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:56.081550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-080ad071-57b3-4c74-80d5-a923d81dd4d8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:56.082246 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-080ad071-57b3-4c74-80d5-a923d81dd4d8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:56.082958 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-080ad071-57b3-4c74-80d5-a923d81dd4d8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:56.084938 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-080ad071-57b3-4c74-80d5-a923d81dd4d8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:56.085747 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-080ad071-57b3-4c74-80d5-a923d81dd4d8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:56.086659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-080ad071-57b3-4c74-80d5-a923d81dd4d8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:56.285758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-080ad071-57b3-4c74-80d5-a923d81dd4d8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:56.296143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-080ad071-57b3-4c74-80d5-a923d81dd4d8 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.233301 Aug 26 06:18:56.296524 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 163/321] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:56 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:56.312816 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-891c6290-6eea-455e-af1e-12825a87b7e5 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:56.312816 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-891c6290-6eea-455e-af1e-12825a87b7e5 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:56.312816 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-891c6290-6eea-455e-af1e-12825a87b7e5 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:56.313192 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-891c6290-6eea-455e-af1e-12825a87b7e5 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:56.313701 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-891c6290-6eea-455e-af1e-12825a87b7e5 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:56.314410 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-891c6290-6eea-455e-af1e-12825a87b7e5 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:56.314898 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-891c6290-6eea-455e-af1e-12825a87b7e5 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:56.315353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-891c6290-6eea-455e-af1e-12825a87b7e5 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:56.470209 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-891c6290-6eea-455e-af1e-12825a87b7e5 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:56.480452 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-891c6290-6eea-455e-af1e-12825a87b7e5 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1470 microversion: 2.1 time: 0.182803 Aug 26 06:18:56.481084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 164/322] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:56 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:18:57.327862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0f53595d-1ba3-425a-8142-5c35ff1bbfed tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:57.328529 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0f53595d-1ba3-425a-8142-5c35ff1bbfed tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:57.335960 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0f53595d-1ba3-425a-8142-5c35ff1bbfed tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:57.336444 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0f53595d-1ba3-425a-8142-5c35ff1bbfed tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:57.336936 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0f53595d-1ba3-425a-8142-5c35ff1bbfed tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:57.337667 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0f53595d-1ba3-425a-8142-5c35ff1bbfed tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:57.338128 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0f53595d-1ba3-425a-8142-5c35ff1bbfed tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:57.338555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0f53595d-1ba3-425a-8142-5c35ff1bbfed tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:57.476629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0f53595d-1ba3-425a-8142-5c35ff1bbfed tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:57.485189 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0f53595d-1ba3-425a-8142-5c35ff1bbfed tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.161361 Aug 26 06:18:57.485768 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 165/323] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:57 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:57.510214 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a5ab4554-7f8a-4e12-a624-e5fc4e57e3de tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:57.510851 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a5ab4554-7f8a-4e12-a624-e5fc4e57e3de tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:57.517066 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ab4554-7f8a-4e12-a624-e5fc4e57e3de tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:57.517550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ab4554-7f8a-4e12-a624-e5fc4e57e3de tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:57.518040 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ab4554-7f8a-4e12-a624-e5fc4e57e3de tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:57.518746 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ab4554-7f8a-4e12-a624-e5fc4e57e3de tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:57.519204 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ab4554-7f8a-4e12-a624-e5fc4e57e3de tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:57.519630 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ab4554-7f8a-4e12-a624-e5fc4e57e3de tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:57.551651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=4 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:18:57.657241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a5ab4554-7f8a-4e12-a624-e5fc4e57e3de tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:57.665870 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a5ab4554-7f8a-4e12-a624-e5fc4e57e3de tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1470 microversion: 2.1 time: 0.160141 Aug 26 06:18:57.666461 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 166/324] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:57 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:58.506419 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-89d6179e-b449-4b75-bf43-752f05ce939e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:58.507259 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-89d6179e-b449-4b75-bf43-752f05ce939e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:58.513050 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89d6179e-b449-4b75-bf43-752f05ce939e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:58.513529 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89d6179e-b449-4b75-bf43-752f05ce939e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:58.513964 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89d6179e-b449-4b75-bf43-752f05ce939e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:58.514678 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89d6179e-b449-4b75-bf43-752f05ce939e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:58.515135 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89d6179e-b449-4b75-bf43-752f05ce939e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:58.515562 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89d6179e-b449-4b75-bf43-752f05ce939e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:58.669480 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-89d6179e-b449-4b75-bf43-752f05ce939e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:58.679250 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-89d6179e-b449-4b75-bf43-752f05ce939e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.177264 Aug 26 06:18:58.679826 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 167/325] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:58 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:58.686996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c7eb0e90-b1aa-47b2-a4aa-12d2aa7b8cf4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:58.687590 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c7eb0e90-b1aa-47b2-a4aa-12d2aa7b8cf4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:58.693840 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7eb0e90-b1aa-47b2-a4aa-12d2aa7b8cf4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:58.694320 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7eb0e90-b1aa-47b2-a4aa-12d2aa7b8cf4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:58.694789 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7eb0e90-b1aa-47b2-a4aa-12d2aa7b8cf4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:58.695485 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7eb0e90-b1aa-47b2-a4aa-12d2aa7b8cf4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:58.695930 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7eb0e90-b1aa-47b2-a4aa-12d2aa7b8cf4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:58.696352 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7eb0e90-b1aa-47b2-a4aa-12d2aa7b8cf4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:58.855776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c7eb0e90-b1aa-47b2-a4aa-12d2aa7b8cf4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:58.864295 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c7eb0e90-b1aa-47b2-a4aa-12d2aa7b8cf4 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1470 microversion: 2.1 time: 0.180771 Aug 26 06:18:58.865138 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 168/326] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:58 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:59.706049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a9b94c85-b509-4490-a9ed-b944567dd321 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:59.707395 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a9b94c85-b509-4490-a9ed-b944567dd321 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:59.715113 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a9b94c85-b509-4490-a9ed-b944567dd321 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:59.715604 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a9b94c85-b509-4490-a9ed-b944567dd321 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:59.716479 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a9b94c85-b509-4490-a9ed-b944567dd321 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:59.716768 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a9b94c85-b509-4490-a9ed-b944567dd321 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:59.717222 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a9b94c85-b509-4490-a9ed-b944567dd321 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:59.717641 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a9b94c85-b509-4490-a9ed-b944567dd321 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:59.884488 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a9b94c85-b509-4490-a9ed-b944567dd321 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:18:59.897322 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a9b94c85-b509-4490-a9ed-b944567dd321 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.198352 Aug 26 06:18:59.910948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 169/327] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:59 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:18:59.910948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-2d45289b-82ec-4eb0-b7dd-8b6d29bcd769 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:18:59.910948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-2d45289b-82ec-4eb0-b7dd-8b6d29bcd769 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:18:59.913799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2d45289b-82ec-4eb0-b7dd-8b6d29bcd769 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:59.914582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2d45289b-82ec-4eb0-b7dd-8b6d29bcd769 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:59.915289 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2d45289b-82ec-4eb0-b7dd-8b6d29bcd769 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:59.916202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2d45289b-82ec-4eb0-b7dd-8b6d29bcd769 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:18:59.916815 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2d45289b-82ec-4eb0-b7dd-8b6d29bcd769 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:18:59.917239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2d45289b-82ec-4eb0-b7dd-8b6d29bcd769 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:18:59.935548 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:00.095877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-2d45289b-82ec-4eb0-b7dd-8b6d29bcd769 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:00.107295 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-2d45289b-82ec-4eb0-b7dd-8b6d29bcd769 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1470 microversion: 2.1 time: 0.207901 Aug 26 06:19:00.107873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 170/328] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:18:59 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1470 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:00.633150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=39 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:00.924476 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-21aa44ac-a159-464f-a1b7-96e31fdb893a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:00.926037 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-21aa44ac-a159-464f-a1b7-96e31fdb893a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:00.932794 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-21aa44ac-a159-464f-a1b7-96e31fdb893a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:00.933257 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-21aa44ac-a159-464f-a1b7-96e31fdb893a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:00.933694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-21aa44ac-a159-464f-a1b7-96e31fdb893a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:00.934397 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-21aa44ac-a159-464f-a1b7-96e31fdb893a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:00.934980 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-21aa44ac-a159-464f-a1b7-96e31fdb893a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:00.935488 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-21aa44ac-a159-464f-a1b7-96e31fdb893a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:01.176857 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-21aa44ac-a159-464f-a1b7-96e31fdb893a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:01.185430 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-21aa44ac-a159-464f-a1b7-96e31fdb893a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.265080 Aug 26 06:19:01.185990 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 171/329] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:00 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:01.190711 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-91b9796e-d648-4a55-9cdb-7e1e90c45a94 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:01.191319 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-91b9796e-d648-4a55-9cdb-7e1e90c45a94 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:01.197646 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91b9796e-d648-4a55-9cdb-7e1e90c45a94 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:01.198348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91b9796e-d648-4a55-9cdb-7e1e90c45a94 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:01.198999 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91b9796e-d648-4a55-9cdb-7e1e90c45a94 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:01.199700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91b9796e-d648-4a55-9cdb-7e1e90c45a94 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:01.200216 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91b9796e-d648-4a55-9cdb-7e1e90c45a94 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:01.200641 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91b9796e-d648-4a55-9cdb-7e1e90c45a94 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:01.395080 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-91b9796e-d648-4a55-9cdb-7e1e90c45a94 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:01.404663 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-91b9796e-d648-4a55-9cdb-7e1e90c45a94 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1470 microversion: 2.1 time: 0.217642 Aug 26 06:19:01.405246 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 172/330] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:01 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:01.815999 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-e3bd5430-a865-4714-bcc3-8fbc995f4ef1 req-973456b2-be31-44ea-8de4-e4b50d210af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4000095-117a-48e3-9606-2bd4a61ae04e", "name": "network-vif-deleted", "tag": "55aba2b1-9455-4767-bf2b-537bec16837d"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:01.827170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e3bd5430-a865-4714-bcc3-8fbc995f4ef1 req-973456b2-be31-44ea-8de4-e4b50d210af3 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:01.827643 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e3bd5430-a865-4714-bcc3-8fbc995f4ef1 req-973456b2-be31-44ea-8de4-e4b50d210af3 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:01.828091 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e3bd5430-a865-4714-bcc3-8fbc995f4ef1 req-973456b2-be31-44ea-8de4-e4b50d210af3 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:01.841603 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-e3bd5430-a865-4714-bcc3-8fbc995f4ef1 req-973456b2-be31-44ea-8de4-e4b50d210af3 service nova] Creating event network-vif-deleted:55aba2b1-9455-4767-bf2b-537bec16837d for instance a4000095-117a-48e3-9606-2bd4a61ae04e on hv-cinder-85391 Aug 26 06:19:01.847831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-e3bd5430-a865-4714-bcc3-8fbc995f4ef1 req-973456b2-be31-44ea-8de4-e4b50d210af3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039218 Aug 26 06:19:01.848592 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 173/331] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:19:02.211471 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-556f6c48-3d53-4705-8d27-b057234c6388 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:02.212317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-556f6c48-3d53-4705-8d27-b057234c6388 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:02.219750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-556f6c48-3d53-4705-8d27-b057234c6388 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:02.220462 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-556f6c48-3d53-4705-8d27-b057234c6388 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:02.221146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-556f6c48-3d53-4705-8d27-b057234c6388 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:02.222025 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-556f6c48-3d53-4705-8d27-b057234c6388 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:02.222785 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-556f6c48-3d53-4705-8d27-b057234c6388 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:02.223879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-556f6c48-3d53-4705-8d27-b057234c6388 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:02.406749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-556f6c48-3d53-4705-8d27-b057234c6388 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:02.411760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-556f6c48-3d53-4705-8d27-b057234c6388 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.206938 Aug 26 06:19:02.412525 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 174/332] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:02 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:02.430961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:02.431644 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:02.438442 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:02.439042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:02.439537 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:02.440234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:02.440685 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:02.441107 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:02.478698 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:02.479195 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:02.479631 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:02.480079 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lazy-loading 'fault' on Instance uuid a4000095-117a-48e3-9606-2bd4a61ae04e {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:19:02.530171 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:02.540125 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4042c217-94f2-48b3-814b-b67fc9ebb53c tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1304 microversion: 2.1 time: 0.112588 Aug 26 06:19:02.540125 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 175/333] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:02 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:19:03.439498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4677619b-6c0d-4c3e-ad85-df3e1fa873a3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:03.441062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4677619b-6c0d-4c3e-ad85-df3e1fa873a3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:03.449658 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4677619b-6c0d-4c3e-ad85-df3e1fa873a3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:03.450214 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4677619b-6c0d-4c3e-ad85-df3e1fa873a3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:03.450743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4677619b-6c0d-4c3e-ad85-df3e1fa873a3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:03.452017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4677619b-6c0d-4c3e-ad85-df3e1fa873a3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:03.452537 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4677619b-6c0d-4c3e-ad85-df3e1fa873a3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:03.453027 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4677619b-6c0d-4c3e-ad85-df3e1fa873a3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:03.613378 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4677619b-6c0d-4c3e-ad85-df3e1fa873a3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:03.623838 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4677619b-6c0d-4c3e-ad85-df3e1fa873a3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.192380 Aug 26 06:19:03.624069 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 176/334] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:03 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:03.629164 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:03.629713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:03.634101 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:03.640685 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:03.650247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:03.650247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:03.650247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:03.650247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:03.650809 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:03.685146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:03.685708 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:03.686118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:03.686561 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lazy-loading 'fault' on Instance uuid a4000095-117a-48e3-9606-2bd4a61ae04e {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:19:03.729826 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0901c2e1c6114d62babc509c46d26b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b173feb98cc4a2788019d9ad62b384f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:03.736608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] validate_networks() for [('f4400288-0fd6-4a35-b08d-549e7c7c455e', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:19:03.738646 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-2db91d25-7517-4093-941b-c8ffb1aae696 tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 200 len: 1304 microversion: 2.1 time: 0.113457 Aug 26 06:19:03.740077 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 177/335] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:03 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:04.410308 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:19:04.410787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:19:04.411253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:19:04.411809 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:19:04.412258 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:19:04.421561 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:04.422034 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:04.422470 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:04.423309 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:04.423765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:04.424190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:04.442374 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Getting quotas for project 84a2eee4447b4eadb79fbdbb874d4476. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:19:04.447378 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Getting quotas for user 8d154e96376a49918658b0c340c722e9 and project 84a2eee4447b4eadb79fbdbb874d4476. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:19:04.459906 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:19:04.462451 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:19:04.646123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e4d3b02f-3552-43d7-87f1-a8225267af37 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:04.646754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e4d3b02f-3552-43d7-87f1-a8225267af37 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:04.653300 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4d3b02f-3552-43d7-87f1-a8225267af37 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:04.653769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4d3b02f-3552-43d7-87f1-a8225267af37 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:04.655431 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4d3b02f-3552-43d7-87f1-a8225267af37 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:04.655431 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4d3b02f-3552-43d7-87f1-a8225267af37 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:04.655637 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4d3b02f-3552-43d7-87f1-a8225267af37 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:04.655896 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4d3b02f-3552-43d7-87f1-a8225267af37 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:04.657661 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-98b9a2db-4f8a-4638-8c9f-d797655e56c0 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 14.050390 Aug 26 06:19:04.660555 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 159/336] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:18:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 14054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:19:04.675790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d5b78d5d-1d8e-47bc-ac70-6ece7f8fd510 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:04.676412 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d5b78d5d-1d8e-47bc-ac70-6ece7f8fd510 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:04.772146 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d5b78d5d-1d8e-47bc-ac70-6ece7f8fd510 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:04.784119 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d5b78d5d-1d8e-47bc-ac70-6ece7f8fd510 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1244 microversion: 2.1 time: 0.112046 Aug 26 06:19:04.784797 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 160/337] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:04 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1244 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:04.793683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:04.794904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] [instance: a4000095-117a-48e3-9606-2bd4a61ae04e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:04.802957 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:04.803918 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:04.804565 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:04.809563 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:04.810480 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:04.811250 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:04.831021 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] HTTP exception thrown: Instance a4000095-117a-48e3-9606-2bd4a61ae04e could not be found. Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Request method failure captured: Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e HTTP/1.1 Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGWxiJXILqxmppgVE9Qr0-8et1mw4SsYYQfzeGpSkcenl5v4Iny-EsYEnxRG8yLiHpLzsE8qBL7qOFAWf2CH3NGbyv630zKCvm3mMHuKwuz57hot3iRAhvh3E_0oLFSS7EGRH2UOLWn9zb6cxEpFAWBRX9_HYAx0PEsGkT0uKgh5ewI Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: 1b173feb98cc4a2788019d9ad62b384f Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-VolumesNegativeTest-1896504933 Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:19:04.833094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b173feb98cc4a2788019d9ad62b384f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b173feb98cc4a2788019d9ad62b384f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b173feb98cc4a2788019d9ad62b384f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b173feb98cc4a2788019d9ad62b384f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-VolumesNegativeTest-1896504933 Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: 1b173feb98cc4a2788019d9ad62b384f Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-VolumesNegativeTest-1896504933 Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-VolumesNegativeTest-1896504933-project Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 0901c2e1c6114d62babc509c46d26b7d Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-VolumesNegativeTest-1896504933-project Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance a4000095-117a-48e3-9606-2bd4a61ae04e could not be found. Aug 26 06:19:04.834819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'a4000095-117a-48e3-9606-2bd4a61ae04e'} Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4000095-117a-48e3-9606-2bd4a61ae04e could not be found. Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:19:04.835644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4000095-117a-48e3-9606-2bd4a61ae04e could not be found. Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4000095-117a-48e3-9606-2bd4a61ae04e could not be found. Aug 26 06:19:04.836863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:19:04.840416 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] Returning 404 to user: Instance a4000095-117a-48e3-9606-2bd4a61ae04e could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:19:04.841773 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c447b706-672c-4546-aa8c-58e20facf8dc tempest-VolumesNegativeTest-1896504933 tempest-VolumesNegativeTest-1896504933-project] 10.222.0.40 "GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e" status: 404 len: 111 microversion: 2.1 time: 0.054379 Aug 26 06:19:04.842997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 161/338] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:04 2022] GET /compute/v2.1/servers/a4000095-117a-48e3-9606-2bd4a61ae04e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:19:04.860942 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e4d3b02f-3552-43d7-87f1-a8225267af37 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:04.873487 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e4d3b02f-3552-43d7-87f1-a8225267af37 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.231112 Aug 26 06:19:04.874677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 178/339] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:04 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:05.811148 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2760b021-98af-48a7-af59-5d2ea6ca7ecf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:05.813184 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2760b021-98af-48a7-af59-5d2ea6ca7ecf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:05.898943 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-442344f6-d119-405c-a09e-5b95d016b1fe tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:05.900241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-442344f6-d119-405c-a09e-5b95d016b1fe tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:05.908556 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-442344f6-d119-405c-a09e-5b95d016b1fe tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:05.909052 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-442344f6-d119-405c-a09e-5b95d016b1fe tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:05.909330 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2760b021-98af-48a7-af59-5d2ea6ca7ecf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:05.909553 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-442344f6-d119-405c-a09e-5b95d016b1fe tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:05.910236 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-442344f6-d119-405c-a09e-5b95d016b1fe tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:05.910716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-442344f6-d119-405c-a09e-5b95d016b1fe tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:05.911145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-442344f6-d119-405c-a09e-5b95d016b1fe tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:05.921228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2760b021-98af-48a7-af59-5d2ea6ca7ecf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1244 microversion: 2.1 time: 0.115079 Aug 26 06:19:05.921799 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 162/340] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:05 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1244 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:06.116268 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-442344f6-d119-405c-a09e-5b95d016b1fe tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:06.125315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-442344f6-d119-405c-a09e-5b95d016b1fe tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.231413 Aug 26 06:19:06.126019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 179/341] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:05 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:06.960091 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-00e1768f-ad52-4469-8b83-546c92f0aaf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:06.963250 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-00e1768f-ad52-4469-8b83-546c92f0aaf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:06.979186 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e1768f-ad52-4469-8b83-546c92f0aaf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:06.980033 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e1768f-ad52-4469-8b83-546c92f0aaf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:06.981088 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e1768f-ad52-4469-8b83-546c92f0aaf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:06.983644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e1768f-ad52-4469-8b83-546c92f0aaf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:06.984458 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e1768f-ad52-4469-8b83-546c92f0aaf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:06.985211 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00e1768f-ad52-4469-8b83-546c92f0aaf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:07.059799 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-00e1768f-ad52-4469-8b83-546c92f0aaf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:07.068031 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-00e1768f-ad52-4469-8b83-546c92f0aaf1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1248 microversion: 2.1 time: 0.122984 Aug 26 06:19:07.068609 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 163/342] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:06 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1248 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:07.155121 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-54f32e02-2f68-48ab-b961-e4e24ea9e356 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:07.155121 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-54f32e02-2f68-48ab-b961-e4e24ea9e356 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:07.164157 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54f32e02-2f68-48ab-b961-e4e24ea9e356 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:07.164659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54f32e02-2f68-48ab-b961-e4e24ea9e356 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:07.165159 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54f32e02-2f68-48ab-b961-e4e24ea9e356 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:07.166343 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54f32e02-2f68-48ab-b961-e4e24ea9e356 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:07.167018 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54f32e02-2f68-48ab-b961-e4e24ea9e356 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:07.168319 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54f32e02-2f68-48ab-b961-e4e24ea9e356 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:07.523668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-54f32e02-2f68-48ab-b961-e4e24ea9e356 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:07.523668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-54f32e02-2f68-48ab-b961-e4e24ea9e356 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.231833 Aug 26 06:19:07.523668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 180/343] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:07 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:08.092282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a50cb1de-8c63-4515-9c9e-4af3190cc258 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:08.092892 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a50cb1de-8c63-4515-9c9e-4af3190cc258 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:08.100717 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50cb1de-8c63-4515-9c9e-4af3190cc258 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:08.101318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50cb1de-8c63-4515-9c9e-4af3190cc258 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:08.101771 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50cb1de-8c63-4515-9c9e-4af3190cc258 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:08.102725 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50cb1de-8c63-4515-9c9e-4af3190cc258 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:08.103421 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50cb1de-8c63-4515-9c9e-4af3190cc258 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:08.104181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a50cb1de-8c63-4515-9c9e-4af3190cc258 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:08.191473 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a50cb1de-8c63-4515-9c9e-4af3190cc258 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:08.205221 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a50cb1de-8c63-4515-9c9e-4af3190cc258 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1240 microversion: 2.1 time: 0.117299 Aug 26 06:19:08.205758 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 164/344] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:08 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:08.542828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5c8cc141-7fe2-4f0e-95fe-0a6c8d596237 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:08.547715 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5c8cc141-7fe2-4f0e-95fe-0a6c8d596237 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:08.563498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c8cc141-7fe2-4f0e-95fe-0a6c8d596237 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:08.564589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c8cc141-7fe2-4f0e-95fe-0a6c8d596237 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:08.565547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c8cc141-7fe2-4f0e-95fe-0a6c8d596237 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:08.567164 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c8cc141-7fe2-4f0e-95fe-0a6c8d596237 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:08.569914 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c8cc141-7fe2-4f0e-95fe-0a6c8d596237 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:08.570899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c8cc141-7fe2-4f0e-95fe-0a6c8d596237 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:08.755132 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5c8cc141-7fe2-4f0e-95fe-0a6c8d596237 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:08.777071 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5c8cc141-7fe2-4f0e-95fe-0a6c8d596237 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.238489 Aug 26 06:19:08.777787 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 181/345] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:08 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:09.240540 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-05281048-f934-45a4-bed0-1edbcac07d21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:09.241153 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-05281048-f934-45a4-bed0-1edbcac07d21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:09.247499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05281048-f934-45a4-bed0-1edbcac07d21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:09.247992 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05281048-f934-45a4-bed0-1edbcac07d21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:09.248503 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05281048-f934-45a4-bed0-1edbcac07d21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:09.249395 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05281048-f934-45a4-bed0-1edbcac07d21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:09.254546 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05281048-f934-45a4-bed0-1edbcac07d21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:09.254546 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05281048-f934-45a4-bed0-1edbcac07d21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:09.342087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-05281048-f934-45a4-bed0-1edbcac07d21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:09.350941 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-05281048-f934-45a4-bed0-1edbcac07d21 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1296 microversion: 2.1 time: 0.114232 Aug 26 06:19:09.363041 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 165/346] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:09 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1296 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:09.809585 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-dfe31060-6780-496c-adfc-4f2c4193a37b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:09.810837 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-dfe31060-6780-496c-adfc-4f2c4193a37b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:09.819372 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dfe31060-6780-496c-adfc-4f2c4193a37b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:09.820943 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dfe31060-6780-496c-adfc-4f2c4193a37b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:09.821582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dfe31060-6780-496c-adfc-4f2c4193a37b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:09.823450 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dfe31060-6780-496c-adfc-4f2c4193a37b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:09.824154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dfe31060-6780-496c-adfc-4f2c4193a37b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:09.824914 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dfe31060-6780-496c-adfc-4f2c4193a37b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:10.294116 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-dfe31060-6780-496c-adfc-4f2c4193a37b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:10.318962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-dfe31060-6780-496c-adfc-4f2c4193a37b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.520573 Aug 26 06:19:10.335193 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 182/347] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:09 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:10.373171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-36b16a61-cd17-4456-bc6a-97b5d790be2d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:10.373806 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-36b16a61-cd17-4456-bc6a-97b5d790be2d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:10.388889 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36b16a61-cd17-4456-bc6a-97b5d790be2d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:10.388889 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36b16a61-cd17-4456-bc6a-97b5d790be2d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:10.388889 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36b16a61-cd17-4456-bc6a-97b5d790be2d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:10.389493 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36b16a61-cd17-4456-bc6a-97b5d790be2d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:10.389493 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36b16a61-cd17-4456-bc6a-97b5d790be2d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:10.390023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-36b16a61-cd17-4456-bc6a-97b5d790be2d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:10.493125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-36b16a61-cd17-4456-bc6a-97b5d790be2d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:10.505969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-36b16a61-cd17-4456-bc6a-97b5d790be2d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1304 microversion: 2.1 time: 0.135769 Aug 26 06:19:10.506563 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 166/348] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:10 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:11.346785 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-376e35f2-4110-4db5-83d7-1f8dc4272b5b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:11.347748 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-376e35f2-4110-4db5-83d7-1f8dc4272b5b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:11.357671 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-376e35f2-4110-4db5-83d7-1f8dc4272b5b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:11.359304 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-376e35f2-4110-4db5-83d7-1f8dc4272b5b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:11.360827 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-376e35f2-4110-4db5-83d7-1f8dc4272b5b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:11.363943 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-376e35f2-4110-4db5-83d7-1f8dc4272b5b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:11.367960 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-376e35f2-4110-4db5-83d7-1f8dc4272b5b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:11.370453 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-376e35f2-4110-4db5-83d7-1f8dc4272b5b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:11.533573 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8d8c9551-07cd-4c2d-9250-02f20acf2ef6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:11.535883 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8d8c9551-07cd-4c2d-9250-02f20acf2ef6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:11.551879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d8c9551-07cd-4c2d-9250-02f20acf2ef6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:11.554833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d8c9551-07cd-4c2d-9250-02f20acf2ef6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:11.555919 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d8c9551-07cd-4c2d-9250-02f20acf2ef6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:11.557452 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d8c9551-07cd-4c2d-9250-02f20acf2ef6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:11.558463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d8c9551-07cd-4c2d-9250-02f20acf2ef6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:11.559411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d8c9551-07cd-4c2d-9250-02f20acf2ef6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:11.594729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-376e35f2-4110-4db5-83d7-1f8dc4272b5b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:11.612646 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-376e35f2-4110-4db5-83d7-1f8dc4272b5b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.268917 Aug 26 06:19:11.616442 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 183/349] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:11 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:11.743235 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8d8c9551-07cd-4c2d-9250-02f20acf2ef6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:11.759309 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8d8c9551-07cd-4c2d-9250-02f20acf2ef6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1302 microversion: 2.1 time: 0.233343 Aug 26 06:19:11.761829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 167/350] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:11 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1302 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:12.655584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c5f0f4d0-0da3-4fd7-868a-4e0fc695a7de tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:12.660234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c5f0f4d0-0da3-4fd7-868a-4e0fc695a7de tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:12.684000 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c5f0f4d0-0da3-4fd7-868a-4e0fc695a7de tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:12.687888 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c5f0f4d0-0da3-4fd7-868a-4e0fc695a7de tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:12.688354 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c5f0f4d0-0da3-4fd7-868a-4e0fc695a7de tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:12.689145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c5f0f4d0-0da3-4fd7-868a-4e0fc695a7de tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:12.689620 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c5f0f4d0-0da3-4fd7-868a-4e0fc695a7de tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:12.690050 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c5f0f4d0-0da3-4fd7-868a-4e0fc695a7de tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:12.808180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-85d2c999-7d51-4e1a-a532-aee733106de6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:12.810401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-85d2c999-7d51-4e1a-a532-aee733106de6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:13.013763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-85d2c999-7d51-4e1a-a532-aee733106de6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:13.013763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-85d2c999-7d51-4e1a-a532-aee733106de6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:13.013763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-85d2c999-7d51-4e1a-a532-aee733106de6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:13.013763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-85d2c999-7d51-4e1a-a532-aee733106de6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:13.017132 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-85d2c999-7d51-4e1a-a532-aee733106de6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:13.017132 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-85d2c999-7d51-4e1a-a532-aee733106de6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:13.096136 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c5f0f4d0-0da3-4fd7-868a-4e0fc695a7de tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:13.109382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c5f0f4d0-0da3-4fd7-868a-4e0fc695a7de tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1699 microversion: 2.1 time: 0.462279 Aug 26 06:19:13.110524 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 184/351] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:12 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1699 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:13.141678 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c8d22e54-3510-47bb-a135-01247479e0c7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:13.149598 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8d22e54-3510-47bb-a135-01247479e0c7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:13.150462 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8d22e54-3510-47bb-a135-01247479e0c7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:13.151153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8d22e54-3510-47bb-a135-01247479e0c7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:13.189913 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-85d2c999-7d51-4e1a-a532-aee733106de6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:13.189913 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:13.200792 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-85d2c999-7d51-4e1a-a532-aee733106de6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.411234 Aug 26 06:19:13.202124 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 168/352] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:12 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:19:13.312142 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c8d22e54-3510-47bb-a135-01247479e0c7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Going to try to start instance {{(pid=121343) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 06:19:13.800894 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c8d22e54-3510-47bb-a135-01247479e0c7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "POST /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/action" status: 202 len: 0 microversion: 2.1 time: 0.663173 Aug 26 06:19:13.808355 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 185/353] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:19:13 2022] POST /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:19:13.812645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fb147f5e-f46d-41d4-be7b-7b902af6212d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:13.813299 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fb147f5e-f46d-41d4-be7b-7b902af6212d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:13.823336 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fb147f5e-f46d-41d4-be7b-7b902af6212d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:13.823837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fb147f5e-f46d-41d4-be7b-7b902af6212d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:13.824282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fb147f5e-f46d-41d4-be7b-7b902af6212d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:13.825003 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fb147f5e-f46d-41d4-be7b-7b902af6212d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:13.825587 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fb147f5e-f46d-41d4-be7b-7b902af6212d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:13.826091 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fb147f5e-f46d-41d4-be7b-7b902af6212d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:14.038717 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fb147f5e-f46d-41d4-be7b-7b902af6212d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:14.047828 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fb147f5e-f46d-41d4-be7b-7b902af6212d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1708 microversion: 2.1 time: 0.239058 Aug 26 06:19:14.048459 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 169/354] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:13 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1708 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:14.225342 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c7d87649-58fb-4696-8f11-6d9dc89fc089 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:14.226425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c7d87649-58fb-4696-8f11-6d9dc89fc089 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:14.233724 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7d87649-58fb-4696-8f11-6d9dc89fc089 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:14.235350 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7d87649-58fb-4696-8f11-6d9dc89fc089 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:14.235953 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7d87649-58fb-4696-8f11-6d9dc89fc089 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:14.236697 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7d87649-58fb-4696-8f11-6d9dc89fc089 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:14.237656 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7d87649-58fb-4696-8f11-6d9dc89fc089 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:14.238252 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c7d87649-58fb-4696-8f11-6d9dc89fc089 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:14.241901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:15.018245 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c7d87649-58fb-4696-8f11-6d9dc89fc089 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:15.029234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c7d87649-58fb-4696-8f11-6d9dc89fc089 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.808814 Aug 26 06:19:15.029814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 186/355] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:14 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:15.076570 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-05400b3c-7dc4-4eef-9101-62d77111f568 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:15.078696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-05400b3c-7dc4-4eef-9101-62d77111f568 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:15.082235 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:15.090399 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05400b3c-7dc4-4eef-9101-62d77111f568 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:15.091667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05400b3c-7dc4-4eef-9101-62d77111f568 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:15.092275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05400b3c-7dc4-4eef-9101-62d77111f568 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:15.093158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05400b3c-7dc4-4eef-9101-62d77111f568 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:15.093773 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05400b3c-7dc4-4eef-9101-62d77111f568 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:15.094908 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-05400b3c-7dc4-4eef-9101-62d77111f568 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:15.432863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-05400b3c-7dc4-4eef-9101-62d77111f568 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:15.465393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-05400b3c-7dc4-4eef-9101-62d77111f568 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1708 microversion: 2.1 time: 0.395706 Aug 26 06:19:15.466109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 170/356] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:15 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1708 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:15.638231 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-f8c55b45-937c-4388-91e3-a89066ce227e req-5417d6f6-8c3b-4daa-932e-d994cd5443a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45330505-4b58-4762-bb9f-e704f9648e1e", "tag": "2064b241-4b48-43a2-ba54-14c868b539b4"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:15.667162 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f8c55b45-937c-4388-91e3-a89066ce227e req-5417d6f6-8c3b-4daa-932e-d994cd5443a6 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:15.668016 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f8c55b45-937c-4388-91e3-a89066ce227e req-5417d6f6-8c3b-4daa-932e-d994cd5443a6 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:15.668735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f8c55b45-937c-4388-91e3-a89066ce227e req-5417d6f6-8c3b-4daa-932e-d994cd5443a6 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:15.721512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-f8c55b45-937c-4388-91e3-a89066ce227e req-5417d6f6-8c3b-4daa-932e-d994cd5443a6 service nova] Creating event network-changed:2064b241-4b48-43a2-ba54-14c868b539b4 for instance 45330505-4b58-4762-bb9f-e704f9648e1e on hv-cinder-85391 Aug 26 06:19:15.745817 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-f8c55b45-937c-4388-91e3-a89066ce227e req-5417d6f6-8c3b-4daa-932e-d994cd5443a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111910 Aug 26 06:19:15.760966 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b5c8ae89-eb72-4c77-9a32-b0e98df364ca tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e602c6a7-302d-4202-9eb4-659b70fa9ab5", "device": "/dev/sdb"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:15.764054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b5c8ae89-eb72-4c77-9a32-b0e98df364ca tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:15.766276 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 187/357] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:19:15.771604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b5c8ae89-eb72-4c77-9a32-b0e98df364ca tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:15.772734 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b5c8ae89-eb72-4c77-9a32-b0e98df364ca tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:15.773358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b5c8ae89-eb72-4c77-9a32-b0e98df364ca tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:15.774455 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b5c8ae89-eb72-4c77-9a32-b0e98df364ca tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:15.775209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b5c8ae89-eb72-4c77-9a32-b0e98df364ca tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:15.775803 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b5c8ae89-eb72-4c77-9a32-b0e98df364ca tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:15.923787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=10 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:16.058713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c2b1bf03-7f1a-4320-ac44-81ba7e9141b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:16.060589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c2b1bf03-7f1a-4320-ac44-81ba7e9141b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:16.073139 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2b1bf03-7f1a-4320-ac44-81ba7e9141b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:16.074347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2b1bf03-7f1a-4320-ac44-81ba7e9141b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:16.075033 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2b1bf03-7f1a-4320-ac44-81ba7e9141b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:16.076031 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2b1bf03-7f1a-4320-ac44-81ba7e9141b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:16.076698 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2b1bf03-7f1a-4320-ac44-81ba7e9141b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:16.077327 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c2b1bf03-7f1a-4320-ac44-81ba7e9141b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:17.116027 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c2b1bf03-7f1a-4320-ac44-81ba7e9141b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:17.116027 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c2b1bf03-7f1a-4320-ac44-81ba7e9141b7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.990634 Aug 26 06:19:17.116027 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 188/358] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:16 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:17.116027 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-04858cf7-c489-458c-a78b-8e483dfcaffa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:17.119772 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-04858cf7-c489-458c-a78b-8e483dfcaffa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:17.119772 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-04858cf7-c489-458c-a78b-8e483dfcaffa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:17.119772 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-04858cf7-c489-458c-a78b-8e483dfcaffa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:17.119772 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-04858cf7-c489-458c-a78b-8e483dfcaffa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:17.121193 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-04858cf7-c489-458c-a78b-8e483dfcaffa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:17.121193 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-04858cf7-c489-458c-a78b-8e483dfcaffa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:17.121193 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-04858cf7-c489-458c-a78b-8e483dfcaffa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:17.208694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-04858cf7-c489-458c-a78b-8e483dfcaffa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:17.218472 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-04858cf7-c489-458c-a78b-8e483dfcaffa tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1708 microversion: 2.1 time: 0.176554 Aug 26 06:19:17.219352 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 189/359] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:17 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1708 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:17.848441 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b5c8ae89-eb72-4c77-9a32-b0e98df364ca tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "POST /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.090187 Aug 26 06:19:17.850105 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 171/360] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:19:15 2022] POST /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea/os-volume_attachments => generated 194 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:19:18.078831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-eb50eaaf-6ad5-4d9c-a4d8-15a65e5d3c6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:18.079903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-eb50eaaf-6ad5-4d9c-a4d8-15a65e5d3c6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:18.104370 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eb50eaaf-6ad5-4d9c-a4d8-15a65e5d3c6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:18.107773 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eb50eaaf-6ad5-4d9c-a4d8-15a65e5d3c6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:18.108317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eb50eaaf-6ad5-4d9c-a4d8-15a65e5d3c6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:18.109047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eb50eaaf-6ad5-4d9c-a4d8-15a65e5d3c6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:18.109508 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eb50eaaf-6ad5-4d9c-a4d8-15a65e5d3c6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:18.116477 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eb50eaaf-6ad5-4d9c-a4d8-15a65e5d3c6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:18.251850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3d7d7b7a-a588-4ae2-9e4b-bc77773e4fe4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:18.253420 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3d7d7b7a-a588-4ae2-9e4b-bc77773e4fe4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:18.270016 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d7d7b7a-a588-4ae2-9e4b-bc77773e4fe4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:18.275879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d7d7b7a-a588-4ae2-9e4b-bc77773e4fe4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:18.276973 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d7d7b7a-a588-4ae2-9e4b-bc77773e4fe4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:18.279279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d7d7b7a-a588-4ae2-9e4b-bc77773e4fe4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:18.281340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d7d7b7a-a588-4ae2-9e4b-bc77773e4fe4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:18.282513 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d7d7b7a-a588-4ae2-9e4b-bc77773e4fe4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:18.421537 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-eb50eaaf-6ad5-4d9c-a4d8-15a65e5d3c6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:18.436279 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-eb50eaaf-6ad5-4d9c-a4d8-15a65e5d3c6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.374129 Aug 26 06:19:18.437439 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 190/361] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:18 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:18.508189 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3d7d7b7a-a588-4ae2-9e4b-bc77773e4fe4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:18.530164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3d7d7b7a-a588-4ae2-9e4b-bc77773e4fe4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1712 microversion: 2.1 time: 0.286783 Aug 26 06:19:18.531596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 172/362] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:18 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1712 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:19.460570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-00686f78-028a-462b-b157-c98ef2ee2e06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:19.461664 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-00686f78-028a-462b-b157-c98ef2ee2e06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:19.476148 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00686f78-028a-462b-b157-c98ef2ee2e06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:19.477101 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00686f78-028a-462b-b157-c98ef2ee2e06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:19.477787 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00686f78-028a-462b-b157-c98ef2ee2e06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:19.479013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00686f78-028a-462b-b157-c98ef2ee2e06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:19.479729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00686f78-028a-462b-b157-c98ef2ee2e06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:19.480437 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-00686f78-028a-462b-b157-c98ef2ee2e06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:19.646071 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-00686f78-028a-462b-b157-c98ef2ee2e06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:19.654044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-00686f78-028a-462b-b157-c98ef2ee2e06 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.199715 Aug 26 06:19:19.658042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 191/363] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:19 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:19:20.687326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dd8b4d39-8afc-4090-b780-e2b29086c402 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:20.687944 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-dd8b4d39-8afc-4090-b780-e2b29086c402 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:20.696537 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd8b4d39-8afc-4090-b780-e2b29086c402 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:20.697030 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd8b4d39-8afc-4090-b780-e2b29086c402 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:20.697465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd8b4d39-8afc-4090-b780-e2b29086c402 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:20.698354 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd8b4d39-8afc-4090-b780-e2b29086c402 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:20.699015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd8b4d39-8afc-4090-b780-e2b29086c402 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:20.699628 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dd8b4d39-8afc-4090-b780-e2b29086c402 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:20.951892 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-dd8b4d39-8afc-4090-b780-e2b29086c402 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:20.968196 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-dd8b4d39-8afc-4090-b780-e2b29086c402 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.290597 Aug 26 06:19:20.970131 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 173/364] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:20 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:22.000987 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d21831e3-c5e4-48cd-af1b-0364b0a7bc81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:22.002371 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d21831e3-c5e4-48cd-af1b-0364b0a7bc81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:22.014822 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d21831e3-c5e4-48cd-af1b-0364b0a7bc81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:22.015435 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d21831e3-c5e4-48cd-af1b-0364b0a7bc81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:22.015970 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d21831e3-c5e4-48cd-af1b-0364b0a7bc81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:22.016812 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d21831e3-c5e4-48cd-af1b-0364b0a7bc81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:22.017377 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d21831e3-c5e4-48cd-af1b-0364b0a7bc81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:22.017903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d21831e3-c5e4-48cd-af1b-0364b0a7bc81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:22.238059 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d21831e3-c5e4-48cd-af1b-0364b0a7bc81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:22.250093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d21831e3-c5e4-48cd-af1b-0364b0a7bc81 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.256776 Aug 26 06:19:22.251127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 192/365] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:21 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:23.290347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ffc02401-f2b4-4e51-8fe2-05de20204f5c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:23.292407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ffc02401-f2b4-4e51-8fe2-05de20204f5c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:23.301460 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffc02401-f2b4-4e51-8fe2-05de20204f5c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:23.302320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffc02401-f2b4-4e51-8fe2-05de20204f5c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:23.303533 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffc02401-f2b4-4e51-8fe2-05de20204f5c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:23.305052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffc02401-f2b4-4e51-8fe2-05de20204f5c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:23.306544 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffc02401-f2b4-4e51-8fe2-05de20204f5c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:23.307437 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffc02401-f2b4-4e51-8fe2-05de20204f5c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:23.564717 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ffc02401-f2b4-4e51-8fe2-05de20204f5c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:23.573441 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ffc02401-f2b4-4e51-8fe2-05de20204f5c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.291065 Aug 26 06:19:23.574502 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 174/366] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:23 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:24.598539 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9f37c767-2d41-471e-a98f-dc9ed460a007 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:24.601847 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9f37c767-2d41-471e-a98f-dc9ed460a007 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:24.617818 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f37c767-2d41-471e-a98f-dc9ed460a007 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:24.618572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f37c767-2d41-471e-a98f-dc9ed460a007 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:24.619170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f37c767-2d41-471e-a98f-dc9ed460a007 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:24.621253 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f37c767-2d41-471e-a98f-dc9ed460a007 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:24.621830 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f37c767-2d41-471e-a98f-dc9ed460a007 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:24.623435 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f37c767-2d41-471e-a98f-dc9ed460a007 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:24.962404 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9f37c767-2d41-471e-a98f-dc9ed460a007 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:24.970583 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9f37c767-2d41-471e-a98f-dc9ed460a007 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.377910 Aug 26 06:19:24.971774 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 193/367] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:24 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:25.785056 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2136196753", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "networks": [{"uuid": "acb716de-6bc0-4261-b952-78c0c00f2891"}]}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:25.888950 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] validate_networks() for [('acb716de-6bc0-4261-b952-78c0c00f2891', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:19:26.043785 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-89062f4c-99de-4d8f-909c-6f4f15be0896 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:26.059314 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-89062f4c-99de-4d8f-909c-6f4f15be0896 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:26.072987 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89062f4c-99de-4d8f-909c-6f4f15be0896 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:26.084771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89062f4c-99de-4d8f-909c-6f4f15be0896 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:26.088291 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89062f4c-99de-4d8f-909c-6f4f15be0896 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:26.089559 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89062f4c-99de-4d8f-909c-6f4f15be0896 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:26.091852 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89062f4c-99de-4d8f-909c-6f4f15be0896 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:26.093742 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89062f4c-99de-4d8f-909c-6f4f15be0896 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:26.558432 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-89062f4c-99de-4d8f-909c-6f4f15be0896 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:26.586005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-89062f4c-99de-4d8f-909c-6f4f15be0896 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.555231 Aug 26 06:19:26.587396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 194/368] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:26 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:26.716152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:19:26.716862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:19:26.717646 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:19:26.720020 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:19:26.720020 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:19:26.742121 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:26.743739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:26.745662 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:26.749318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:26.751073 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:26.752204 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:26.792352 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Getting quotas for project b38f9319c7534904ac58d1d9f9048b91. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:19:26.799189 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Getting quotas for user 2cffd4ac2817448e94d2b32ac7ffcede and project b38f9319c7534904ac58d1d9f9048b91. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:19:26.837803 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:19:26.849084 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:19:27.173331 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2f72dcbd-3561-462f-a292-9058268cfeff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.405183 Aug 26 06:19:27.177326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 175/369] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:19:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 06:19:27.196488 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d37edbd8-27a9-461c-97a9-208564ffb48e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:27.204192 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d37edbd8-27a9-461c-97a9-208564ffb48e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:27.592476 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d37edbd8-27a9-461c-97a9-208564ffb48e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:27.604944 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d37edbd8-27a9-461c-97a9-208564ffb48e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1214 microversion: 2.1 time: 0.421708 Aug 26 06:19:27.605617 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 195/370] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:27 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1214 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:27.620156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c8be8217-79cf-443e-a17a-48c5a4cc966e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:27.620156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c8be8217-79cf-443e-a17a-48c5a4cc966e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:27.623838 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8be8217-79cf-443e-a17a-48c5a4cc966e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:27.623838 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8be8217-79cf-443e-a17a-48c5a4cc966e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:27.623838 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8be8217-79cf-443e-a17a-48c5a4cc966e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:27.626299 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8be8217-79cf-443e-a17a-48c5a4cc966e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:27.626299 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8be8217-79cf-443e-a17a-48c5a4cc966e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:27.626299 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8be8217-79cf-443e-a17a-48c5a4cc966e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:27.745083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-be641977-7bb7-4c88-a7f9-bdd5c59c702d req-690c7ced-0cd1-4e16-b6a8-db8e471cce08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45330505-4b58-4762-bb9f-e704f9648e1e", "name": "network-vif-plugged", "status": "completed", "tag": "2064b241-4b48-43a2-ba54-14c868b539b4"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:27.764912 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-be641977-7bb7-4c88-a7f9-bdd5c59c702d req-690c7ced-0cd1-4e16-b6a8-db8e471cce08 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:27.765661 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-be641977-7bb7-4c88-a7f9-bdd5c59c702d req-690c7ced-0cd1-4e16-b6a8-db8e471cce08 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:27.766259 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-be641977-7bb7-4c88-a7f9-bdd5c59c702d req-690c7ced-0cd1-4e16-b6a8-db8e471cce08 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:27.793438 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-be641977-7bb7-4c88-a7f9-bdd5c59c702d req-690c7ced-0cd1-4e16-b6a8-db8e471cce08 service nova] Creating event network-vif-plugged:2064b241-4b48-43a2-ba54-14c868b539b4 for instance 45330505-4b58-4762-bb9f-e704f9648e1e on hv-cinder-85391 Aug 26 06:19:27.794249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-be641977-7bb7-4c88-a7f9-bdd5c59c702d req-690c7ced-0cd1-4e16-b6a8-db8e471cce08 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054549 Aug 26 06:19:27.797180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 196/371] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:19:28.572009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c8be8217-79cf-443e-a17a-48c5a4cc966e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:28.591152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c8be8217-79cf-443e-a17a-48c5a4cc966e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.985522 Aug 26 06:19:28.594096 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 176/372] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:27 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:28.636549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-36ab1ade-69bd-4e2b-ab85-3a9cf27bddfe tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:28.639519 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-36ab1ade-69bd-4e2b-ab85-3a9cf27bddfe tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:28.729776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-36ab1ade-69bd-4e2b-ab85-3a9cf27bddfe tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:28.737215 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-36ab1ade-69bd-4e2b-ab85-3a9cf27bddfe tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1214 microversion: 2.1 time: 0.108681 Aug 26 06:19:28.739978 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 197/373] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:28 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:29.628833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a51cb9b7-63fe-4404-a58a-d72cb60e2ff6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:29.630179 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a51cb9b7-63fe-4404-a58a-d72cb60e2ff6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:29.636428 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51cb9b7-63fe-4404-a58a-d72cb60e2ff6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:29.636938 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51cb9b7-63fe-4404-a58a-d72cb60e2ff6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:29.637426 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51cb9b7-63fe-4404-a58a-d72cb60e2ff6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:29.638140 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51cb9b7-63fe-4404-a58a-d72cb60e2ff6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:29.639087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51cb9b7-63fe-4404-a58a-d72cb60e2ff6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:29.639288 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51cb9b7-63fe-4404-a58a-d72cb60e2ff6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:29.769614 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a148be5d-c9b4-4fff-b10b-60d962517271 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:29.771945 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a148be5d-c9b4-4fff-b10b-60d962517271 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:29.858196 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a51cb9b7-63fe-4404-a58a-d72cb60e2ff6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:29.872082 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a51cb9b7-63fe-4404-a58a-d72cb60e2ff6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.247071 Aug 26 06:19:29.889160 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 177/374] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:29 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:29.965799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a148be5d-c9b4-4fff-b10b-60d962517271 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:29.977552 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a148be5d-c9b4-4fff-b10b-60d962517271 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1214 microversion: 2.1 time: 0.221663 Aug 26 06:19:29.992139 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 198/375] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:29 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1214 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:30.903875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7c067eb5-8f52-49ca-9597-282b6e530231 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:30.904601 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7c067eb5-8f52-49ca-9597-282b6e530231 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:30.950655 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c067eb5-8f52-49ca-9597-282b6e530231 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:30.962594 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c067eb5-8f52-49ca-9597-282b6e530231 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:30.963230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c067eb5-8f52-49ca-9597-282b6e530231 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:30.964030 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c067eb5-8f52-49ca-9597-282b6e530231 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:30.964475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c067eb5-8f52-49ca-9597-282b6e530231 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:30.964914 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c067eb5-8f52-49ca-9597-282b6e530231 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:31.011137 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-03486b60-2c34-486f-ab63-ad74c0fad224 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:31.011137 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-03486b60-2c34-486f-ab63-ad74c0fad224 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:31.034185 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03486b60-2c34-486f-ab63-ad74c0fad224 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:31.035092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03486b60-2c34-486f-ab63-ad74c0fad224 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:31.043241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03486b60-2c34-486f-ab63-ad74c0fad224 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:31.044290 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03486b60-2c34-486f-ab63-ad74c0fad224 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:31.044959 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03486b60-2c34-486f-ab63-ad74c0fad224 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:31.045986 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03486b60-2c34-486f-ab63-ad74c0fad224 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:31.148947 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-03486b60-2c34-486f-ab63-ad74c0fad224 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:31.164253 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-03486b60-2c34-486f-ab63-ad74c0fad224 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1218 microversion: 2.1 time: 0.163346 Aug 26 06:19:31.165131 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 199/376] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:30 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:19:31.214062 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7c067eb5-8f52-49ca-9597-282b6e530231 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:31.225011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7c067eb5-8f52-49ca-9597-282b6e530231 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.325110 Aug 26 06:19:31.226666 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 178/377] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:30 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:32.186531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f1676057-6bab-426c-8098-6c3b5253b515 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:32.187369 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f1676057-6bab-426c-8098-6c3b5253b515 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:32.196443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1676057-6bab-426c-8098-6c3b5253b515 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:32.197257 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1676057-6bab-426c-8098-6c3b5253b515 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:32.197860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1676057-6bab-426c-8098-6c3b5253b515 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:32.199055 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1676057-6bab-426c-8098-6c3b5253b515 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:32.199714 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1676057-6bab-426c-8098-6c3b5253b515 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:32.200331 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1676057-6bab-426c-8098-6c3b5253b515 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:32.248197 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-df7e449a-fc42-4a3d-b821-5a9e30e2c846 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:32.255861 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-df7e449a-fc42-4a3d-b821-5a9e30e2c846 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:32.270586 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df7e449a-fc42-4a3d-b821-5a9e30e2c846 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:32.279195 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df7e449a-fc42-4a3d-b821-5a9e30e2c846 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:32.281284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df7e449a-fc42-4a3d-b821-5a9e30e2c846 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:32.282160 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df7e449a-fc42-4a3d-b821-5a9e30e2c846 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:32.282870 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df7e449a-fc42-4a3d-b821-5a9e30e2c846 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:32.283494 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df7e449a-fc42-4a3d-b821-5a9e30e2c846 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:32.330859 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f1676057-6bab-426c-8098-6c3b5253b515 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:32.341540 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f1676057-6bab-426c-8098-6c3b5253b515 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1218 microversion: 2.1 time: 0.159711 Aug 26 06:19:32.342322 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 200/378] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:32 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:32.603284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-df7e449a-fc42-4a3d-b821-5a9e30e2c846 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:32.621023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-df7e449a-fc42-4a3d-b821-5a9e30e2c846 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.376547 Aug 26 06:19:32.621806 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 179/379] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:32 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:19:33.385627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-44e6e5e3-5278-45c3-8472-5984e9abb466 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:33.386951 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-44e6e5e3-5278-45c3-8472-5984e9abb466 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:33.394170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44e6e5e3-5278-45c3-8472-5984e9abb466 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:33.394700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44e6e5e3-5278-45c3-8472-5984e9abb466 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:33.395996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44e6e5e3-5278-45c3-8472-5984e9abb466 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:33.397292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44e6e5e3-5278-45c3-8472-5984e9abb466 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:33.397916 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44e6e5e3-5278-45c3-8472-5984e9abb466 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:33.398718 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44e6e5e3-5278-45c3-8472-5984e9abb466 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:33.490360 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-44e6e5e3-5278-45c3-8472-5984e9abb466 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:33.498781 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-44e6e5e3-5278-45c3-8472-5984e9abb466 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1218 microversion: 2.1 time: 0.132408 Aug 26 06:19:33.504016 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 201/380] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:33 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:33.655536 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-969b4acb-bbde-4641-ba8b-9508ebe63b6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:33.656359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-969b4acb-bbde-4641-ba8b-9508ebe63b6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:33.672227 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:33.675259 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-969b4acb-bbde-4641-ba8b-9508ebe63b6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:33.676200 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-969b4acb-bbde-4641-ba8b-9508ebe63b6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:33.690795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-969b4acb-bbde-4641-ba8b-9508ebe63b6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:33.690795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-969b4acb-bbde-4641-ba8b-9508ebe63b6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:33.690795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-969b4acb-bbde-4641-ba8b-9508ebe63b6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:33.690795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-969b4acb-bbde-4641-ba8b-9508ebe63b6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:34.025463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-969b4acb-bbde-4641-ba8b-9508ebe63b6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:34.050997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-969b4acb-bbde-4641-ba8b-9508ebe63b6d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.399424 Aug 26 06:19:34.056848 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 180/381] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:33 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:34.523185 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f0f2ab5b-801c-4dbd-92a9-57dfbffd8887 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:34.524565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f0f2ab5b-801c-4dbd-92a9-57dfbffd8887 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:34.539196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0f2ab5b-801c-4dbd-92a9-57dfbffd8887 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:34.540308 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0f2ab5b-801c-4dbd-92a9-57dfbffd8887 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:34.544507 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0f2ab5b-801c-4dbd-92a9-57dfbffd8887 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:34.545828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0f2ab5b-801c-4dbd-92a9-57dfbffd8887 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:34.546584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0f2ab5b-801c-4dbd-92a9-57dfbffd8887 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:34.550259 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0f2ab5b-801c-4dbd-92a9-57dfbffd8887 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:34.696835 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f0f2ab5b-801c-4dbd-92a9-57dfbffd8887 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:34.725665 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f0f2ab5b-801c-4dbd-92a9-57dfbffd8887 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1218 microversion: 2.1 time: 0.207886 Aug 26 06:19:34.732860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 202/382] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:34 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1218 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:35.086117 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e7730007-c4f0-4c8c-9901-c33a7173880c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:35.086929 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e7730007-c4f0-4c8c-9901-c33a7173880c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:35.101843 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e7730007-c4f0-4c8c-9901-c33a7173880c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:35.102706 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e7730007-c4f0-4c8c-9901-c33a7173880c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:35.103228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e7730007-c4f0-4c8c-9901-c33a7173880c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:35.111834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e7730007-c4f0-4c8c-9901-c33a7173880c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:35.112487 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e7730007-c4f0-4c8c-9901-c33a7173880c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:35.113185 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e7730007-c4f0-4c8c-9901-c33a7173880c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:35.507571 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e7730007-c4f0-4c8c-9901-c33a7173880c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:35.518041 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e7730007-c4f0-4c8c-9901-c33a7173880c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.436700 Aug 26 06:19:35.519097 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 181/383] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:35 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:35.759178 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-2211631c-c488-45ae-80ee-0ddb4f011735 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:35.760927 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-2211631c-c488-45ae-80ee-0ddb4f011735 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:35.768891 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2211631c-c488-45ae-80ee-0ddb4f011735 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:35.769528 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2211631c-c488-45ae-80ee-0ddb4f011735 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:35.771783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2211631c-c488-45ae-80ee-0ddb4f011735 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:35.772805 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2211631c-c488-45ae-80ee-0ddb4f011735 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:35.773518 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2211631c-c488-45ae-80ee-0ddb4f011735 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:35.774229 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2211631c-c488-45ae-80ee-0ddb4f011735 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:35.882724 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-2211631c-c488-45ae-80ee-0ddb4f011735 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:35.899035 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-2211631c-c488-45ae-80ee-0ddb4f011735 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1218 microversion: 2.1 time: 0.150599 Aug 26 06:19:35.902154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 203/384] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:35 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:36.544022 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-30a749fe-01de-4a4d-a1db-53183f330eb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:36.545311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-30a749fe-01de-4a4d-a1db-53183f330eb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:36.561355 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-30a749fe-01de-4a4d-a1db-53183f330eb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:36.566445 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-30a749fe-01de-4a4d-a1db-53183f330eb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:36.567370 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-30a749fe-01de-4a4d-a1db-53183f330eb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:36.568380 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-30a749fe-01de-4a4d-a1db-53183f330eb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:36.575663 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-30a749fe-01de-4a4d-a1db-53183f330eb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:36.576463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-30a749fe-01de-4a4d-a1db-53183f330eb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:36.777476 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:36.814497 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=6 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:36.930590 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8482e7fe-05c8-4e2b-9865-0277f5627aad tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:36.931865 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8482e7fe-05c8-4e2b-9865-0277f5627aad tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:36.946130 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8482e7fe-05c8-4e2b-9865-0277f5627aad tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:36.949962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8482e7fe-05c8-4e2b-9865-0277f5627aad tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:36.950737 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8482e7fe-05c8-4e2b-9865-0277f5627aad tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:36.952306 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8482e7fe-05c8-4e2b-9865-0277f5627aad tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:36.953184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8482e7fe-05c8-4e2b-9865-0277f5627aad tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:36.957260 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8482e7fe-05c8-4e2b-9865-0277f5627aad tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:37.047333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-30a749fe-01de-4a4d-a1db-53183f330eb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:37.059378 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-30a749fe-01de-4a4d-a1db-53183f330eb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.516877 Aug 26 06:19:37.061439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 182/385] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:36 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:37.228939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8482e7fe-05c8-4e2b-9865-0277f5627aad tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:37.244276 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8482e7fe-05c8-4e2b-9865-0277f5627aad tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1210 microversion: 2.1 time: 0.319116 Aug 26 06:19:37.266475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 204/386] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:36 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1210 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:38.087029 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-00dc62da-673e-4bca-88b2-2f7898d07af6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:38.088216 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-00dc62da-673e-4bca-88b2-2f7898d07af6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:38.110984 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00dc62da-673e-4bca-88b2-2f7898d07af6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:38.112564 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00dc62da-673e-4bca-88b2-2f7898d07af6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:38.113095 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00dc62da-673e-4bca-88b2-2f7898d07af6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:38.114629 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00dc62da-673e-4bca-88b2-2f7898d07af6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:38.115877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00dc62da-673e-4bca-88b2-2f7898d07af6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:38.119147 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-00dc62da-673e-4bca-88b2-2f7898d07af6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:38.284807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7157b05e-eb95-4964-8711-29597aa5d0a9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:38.285734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7157b05e-eb95-4964-8711-29597aa5d0a9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:38.324114 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7157b05e-eb95-4964-8711-29597aa5d0a9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:38.324114 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7157b05e-eb95-4964-8711-29597aa5d0a9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:38.324114 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7157b05e-eb95-4964-8711-29597aa5d0a9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:38.331746 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7157b05e-eb95-4964-8711-29597aa5d0a9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:38.336693 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7157b05e-eb95-4964-8711-29597aa5d0a9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:38.338194 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7157b05e-eb95-4964-8711-29597aa5d0a9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:38.580101 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7157b05e-eb95-4964-8711-29597aa5d0a9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:38.591748 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7157b05e-eb95-4964-8711-29597aa5d0a9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1266 microversion: 2.1 time: 0.322079 Aug 26 06:19:38.595985 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 205/387] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:38 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:38.673323 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-00dc62da-673e-4bca-88b2-2f7898d07af6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:38.684753 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-00dc62da-673e-4bca-88b2-2f7898d07af6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.606962 Aug 26 06:19:38.686279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 183/388] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:38 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:39.625659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-61def0de-cc60-4ce1-85ea-1d5f9b29941c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:39.629172 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-61def0de-cc60-4ce1-85ea-1d5f9b29941c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:39.649698 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-61def0de-cc60-4ce1-85ea-1d5f9b29941c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:39.650190 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-61def0de-cc60-4ce1-85ea-1d5f9b29941c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:39.650647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-61def0de-cc60-4ce1-85ea-1d5f9b29941c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:39.651414 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-61def0de-cc60-4ce1-85ea-1d5f9b29941c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:39.651861 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-61def0de-cc60-4ce1-85ea-1d5f9b29941c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:39.652280 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-61def0de-cc60-4ce1-85ea-1d5f9b29941c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:39.714704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ea878764-b944-4402-880a-88a73acc3c6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:39.715322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ea878764-b944-4402-880a-88a73acc3c6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:39.737560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea878764-b944-4402-880a-88a73acc3c6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:39.738066 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea878764-b944-4402-880a-88a73acc3c6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:39.738647 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea878764-b944-4402-880a-88a73acc3c6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:39.760281 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea878764-b944-4402-880a-88a73acc3c6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:39.761582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea878764-b944-4402-880a-88a73acc3c6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:39.762604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ea878764-b944-4402-880a-88a73acc3c6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:39.852562 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-61def0de-cc60-4ce1-85ea-1d5f9b29941c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:39.905804 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-61def0de-cc60-4ce1-85ea-1d5f9b29941c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1266 microversion: 2.1 time: 0.280387 Aug 26 06:19:39.928641 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 206/389] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:39 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:40.096872 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ea878764-b944-4402-880a-88a73acc3c6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:40.101875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:40.112374 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ea878764-b944-4402-880a-88a73acc3c6a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1370 microversion: 2.1 time: 0.404226 Aug 26 06:19:40.119569 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 184/390] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:39 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1370 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:19:40.940087 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0fe4dccb-17c5-4f5c-9e14-93a8e36a6a30 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:40.940761 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0fe4dccb-17c5-4f5c-9e14-93a8e36a6a30 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:40.944212 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=6 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:40.950378 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0fe4dccb-17c5-4f5c-9e14-93a8e36a6a30 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:40.950908 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0fe4dccb-17c5-4f5c-9e14-93a8e36a6a30 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:40.951347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0fe4dccb-17c5-4f5c-9e14-93a8e36a6a30 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:40.952089 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0fe4dccb-17c5-4f5c-9e14-93a8e36a6a30 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:40.952541 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0fe4dccb-17c5-4f5c-9e14-93a8e36a6a30 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:40.952992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0fe4dccb-17c5-4f5c-9e14-93a8e36a6a30 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:40.955972 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=100 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:41.055993 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0fe4dccb-17c5-4f5c-9e14-93a8e36a6a30 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:41.066971 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0fe4dccb-17c5-4f5c-9e14-93a8e36a6a30 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1274 microversion: 2.1 time: 0.130904 Aug 26 06:19:41.068236 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 207/391] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:40 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:41.141259 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8d863726-28e2-498e-8778-18aa0481e23c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:41.141871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8d863726-28e2-498e-8778-18aa0481e23c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:41.151224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d863726-28e2-498e-8778-18aa0481e23c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:41.151772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d863726-28e2-498e-8778-18aa0481e23c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:41.152214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d863726-28e2-498e-8778-18aa0481e23c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:41.154983 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d863726-28e2-498e-8778-18aa0481e23c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:41.154983 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d863726-28e2-498e-8778-18aa0481e23c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:41.154983 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8d863726-28e2-498e-8778-18aa0481e23c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:41.402593 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8d863726-28e2-498e-8778-18aa0481e23c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:41.442853 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8d863726-28e2-498e-8778-18aa0481e23c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1563 microversion: 2.1 time: 0.302002 Aug 26 06:19:41.443916 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 185/392] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:41 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1563 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:41.469446 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7c7c1eac-eb68-4831-8516-22b4d079b29d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:41.470315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7c7c1eac-eb68-4831-8516-22b4d079b29d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:41.488516 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c7c1eac-eb68-4831-8516-22b4d079b29d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:41.491887 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c7c1eac-eb68-4831-8516-22b4d079b29d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:41.492992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c7c1eac-eb68-4831-8516-22b4d079b29d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:41.494347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c7c1eac-eb68-4831-8516-22b4d079b29d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:41.498387 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c7c1eac-eb68-4831-8516-22b4d079b29d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:41.499159 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c7c1eac-eb68-4831-8516-22b4d079b29d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:41.912600 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7c7c1eac-eb68-4831-8516-22b4d079b29d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.446175 Aug 26 06:19:41.913666 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 208/393] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 06:19:41 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-interface => generated 284 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:19:42.095018 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-90efd14a-a9d4-42d8-b586-f2381ba21812 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:42.096294 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-90efd14a-a9d4-42d8-b586-f2381ba21812 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:42.124969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90efd14a-a9d4-42d8-b586-f2381ba21812 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:42.127363 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90efd14a-a9d4-42d8-b586-f2381ba21812 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:42.128108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90efd14a-a9d4-42d8-b586-f2381ba21812 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:42.132630 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90efd14a-a9d4-42d8-b586-f2381ba21812 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:42.133609 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90efd14a-a9d4-42d8-b586-f2381ba21812 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:42.135495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90efd14a-a9d4-42d8-b586-f2381ba21812 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:42.381726 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-90efd14a-a9d4-42d8-b586-f2381ba21812 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:42.389732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-90efd14a-a9d4-42d8-b586-f2381ba21812 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1274 microversion: 2.1 time: 0.301245 Aug 26 06:19:42.392318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 186/394] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:42 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1274 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:43.442297 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e5ca2e46-010d-4001-a680-73f35899f669 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:43.450175 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e5ca2e46-010d-4001-a680-73f35899f669 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:43.491621 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5ca2e46-010d-4001-a680-73f35899f669 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:43.493168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5ca2e46-010d-4001-a680-73f35899f669 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:43.496661 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5ca2e46-010d-4001-a680-73f35899f669 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:43.503124 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5ca2e46-010d-4001-a680-73f35899f669 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:43.503844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5ca2e46-010d-4001-a680-73f35899f669 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:43.520379 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e5ca2e46-010d-4001-a680-73f35899f669 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:43.916083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e5ca2e46-010d-4001-a680-73f35899f669 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:43.927411 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e5ca2e46-010d-4001-a680-73f35899f669 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1284 microversion: 2.1 time: 0.497072 Aug 26 06:19:43.945099 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 209/395] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:43 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1284 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:44.957434 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6e9579fe-b37f-454f-80f2-51e63babfb36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:44.967102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6e9579fe-b37f-454f-80f2-51e63babfb36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:45.016915 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e9579fe-b37f-454f-80f2-51e63babfb36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:45.017456 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e9579fe-b37f-454f-80f2-51e63babfb36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:45.017905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e9579fe-b37f-454f-80f2-51e63babfb36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:45.021173 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e9579fe-b37f-454f-80f2-51e63babfb36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:45.024247 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e9579fe-b37f-454f-80f2-51e63babfb36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:45.030025 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e9579fe-b37f-454f-80f2-51e63babfb36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:45.228646 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6e9579fe-b37f-454f-80f2-51e63babfb36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:45.255771 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6e9579fe-b37f-454f-80f2-51e63babfb36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1272 microversion: 2.1 time: 0.308986 Aug 26 06:19:45.258658 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 187/396] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:44 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1272 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:46.033553 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-e95e943f-327b-4717-8a1b-8893b80c4921 req-7acd81f1-db5d-456c-83b8-bf4e9f40b828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45330505-4b58-4762-bb9f-e704f9648e1e", "tag": "2064b241-4b48-43a2-ba54-14c868b539b4"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:46.062478 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=74 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:19:46.091843 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e95e943f-327b-4717-8a1b-8893b80c4921 req-7acd81f1-db5d-456c-83b8-bf4e9f40b828 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:46.094246 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e95e943f-327b-4717-8a1b-8893b80c4921 req-7acd81f1-db5d-456c-83b8-bf4e9f40b828 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:46.105380 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e95e943f-327b-4717-8a1b-8893b80c4921 req-7acd81f1-db5d-456c-83b8-bf4e9f40b828 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:46.163078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-e95e943f-327b-4717-8a1b-8893b80c4921 req-7acd81f1-db5d-456c-83b8-bf4e9f40b828 service nova] Creating event network-changed:2064b241-4b48-43a2-ba54-14c868b539b4 for instance 45330505-4b58-4762-bb9f-e704f9648e1e on hv-cinder-85391 Aug 26 06:19:46.185683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-e95e943f-327b-4717-8a1b-8893b80c4921 req-7acd81f1-db5d-456c-83b8-bf4e9f40b828 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157512 Aug 26 06:19:46.201153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 210/397] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:19:46.282783 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a75ff573-2eea-4fef-af77-d29d793fae8e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:46.284397 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a75ff573-2eea-4fef-af77-d29d793fae8e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:46.303355 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a75ff573-2eea-4fef-af77-d29d793fae8e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:46.316689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a75ff573-2eea-4fef-af77-d29d793fae8e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:46.322467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a75ff573-2eea-4fef-af77-d29d793fae8e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:46.330464 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a75ff573-2eea-4fef-af77-d29d793fae8e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:46.331366 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a75ff573-2eea-4fef-af77-d29d793fae8e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:46.332142 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a75ff573-2eea-4fef-af77-d29d793fae8e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:47.268398 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a75ff573-2eea-4fef-af77-d29d793fae8e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:47.283786 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a75ff573-2eea-4fef-af77-d29d793fae8e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 1.005362 Aug 26 06:19:47.287847 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 188/398] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:46 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:48.330825 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-05b89cef-7a51-4cbe-96c4-434a1c1af3bb tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:48.337249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-05b89cef-7a51-4cbe-96c4-434a1c1af3bb tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:48.348095 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b89cef-7a51-4cbe-96c4-434a1c1af3bb tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:48.349423 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b89cef-7a51-4cbe-96c4-434a1c1af3bb tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:48.349988 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b89cef-7a51-4cbe-96c4-434a1c1af3bb tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:48.351201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b89cef-7a51-4cbe-96c4-434a1c1af3bb tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:48.351669 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b89cef-7a51-4cbe-96c4-434a1c1af3bb tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:48.352100 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b89cef-7a51-4cbe-96c4-434a1c1af3bb tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:48.617879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-05b89cef-7a51-4cbe-96c4-434a1c1af3bb tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:48.643846 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-05b89cef-7a51-4cbe-96c4-434a1c1af3bb tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.326051 Aug 26 06:19:48.644461 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 211/399] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:48 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:49.675047 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dfe8d470-1e71-4933-8c83-b673e0d5f94a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:49.675627 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-dfe8d470-1e71-4933-8c83-b673e0d5f94a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:49.683601 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfe8d470-1e71-4933-8c83-b673e0d5f94a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:49.684369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfe8d470-1e71-4933-8c83-b673e0d5f94a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:49.684960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfe8d470-1e71-4933-8c83-b673e0d5f94a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:49.685840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfe8d470-1e71-4933-8c83-b673e0d5f94a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:49.686447 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfe8d470-1e71-4933-8c83-b673e0d5f94a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:49.687052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfe8d470-1e71-4933-8c83-b673e0d5f94a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:49.837624 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-82568f6c-6d65-42b3-a82f-64b043e8a181 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:49.838560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-82568f6c-6d65-42b3-a82f-64b043e8a181 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:49.867842 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82568f6c-6d65-42b3-a82f-64b043e8a181 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:49.868948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82568f6c-6d65-42b3-a82f-64b043e8a181 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:49.871065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82568f6c-6d65-42b3-a82f-64b043e8a181 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:49.873193 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82568f6c-6d65-42b3-a82f-64b043e8a181 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:49.874457 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82568f6c-6d65-42b3-a82f-64b043e8a181 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:49.876258 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82568f6c-6d65-42b3-a82f-64b043e8a181 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:49.962980 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-82568f6c-6d65-42b3-a82f-64b043e8a181 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/ips" status: 200 len: 152 microversion: 2.20 time: 0.132935 Aug 26 06:19:49.965222 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 212/400] 10.222.0.40 () {60 vars in 1289 bytes} [Fri Aug 26 06:19:49 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/ips => generated 152 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 06:19:50.001752 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-dfe8d470-1e71-4933-8c83-b673e0d5f94a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:50.017514 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-dfe8d470-1e71-4933-8c83-b673e0d5f94a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.343769 Aug 26 06:19:50.017514 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 189/401] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:49 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:50.966906 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-d2ff91ba-7efa-475f-bea7-01186ac32784 req-7572a1f2-4308-472e-9ed7-0e3815516691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1745aea6-2b4b-48cb-82d5-3c6f62c9196d", "tag": "56fec6a1-e21d-4fe6-ba05-e70da56fde9b"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:51.149393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-d2ff91ba-7efa-475f-bea7-01186ac32784 req-7572a1f2-4308-472e-9ed7-0e3815516691 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:51.149393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-d2ff91ba-7efa-475f-bea7-01186ac32784 req-7572a1f2-4308-472e-9ed7-0e3815516691 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:51.149393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-d2ff91ba-7efa-475f-bea7-01186ac32784 req-7572a1f2-4308-472e-9ed7-0e3815516691 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:51.149393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-d2ff91ba-7efa-475f-bea7-01186ac32784 req-7572a1f2-4308-472e-9ed7-0e3815516691 service nova] Creating event network-changed:56fec6a1-e21d-4fe6-ba05-e70da56fde9b for instance 1745aea6-2b4b-48cb-82d5-3c6f62c9196d on hv-cinder-85391 Aug 26 06:19:51.152247 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-bea1e6a4-b215-4a4c-b2fb-5ab0896cea0b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:51.152247 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-bea1e6a4-b215-4a4c-b2fb-5ab0896cea0b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:51.153189 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-d2ff91ba-7efa-475f-bea7-01186ac32784 req-7572a1f2-4308-472e-9ed7-0e3815516691 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105522 Aug 26 06:19:51.153189 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 213/402] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:19:51.153627 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bea1e6a4-b215-4a4c-b2fb-5ab0896cea0b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:51.153627 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bea1e6a4-b215-4a4c-b2fb-5ab0896cea0b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:51.153627 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bea1e6a4-b215-4a4c-b2fb-5ab0896cea0b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:51.153627 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bea1e6a4-b215-4a4c-b2fb-5ab0896cea0b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:51.154252 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bea1e6a4-b215-4a4c-b2fb-5ab0896cea0b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:51.154252 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bea1e6a4-b215-4a4c-b2fb-5ab0896cea0b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:51.511234 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-bea1e6a4-b215-4a4c-b2fb-5ab0896cea0b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:51.526034 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-bea1e6a4-b215-4a4c-b2fb-5ab0896cea0b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.475431 Aug 26 06:19:51.529384 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 190/403] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:51 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:51.906527 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-2d4f314e-b274-48a6-933d-fbe6db63af6e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Action: 'create', calling method: .version_select at 0x7f2f093e75e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1551638034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/xgAOeSrYlFi8UWhN234ruDz9YU1uX0CgUdHveIi3GdhdmdsQuW2E7Y8OPEIxF5/EuC+tDSw7Nb8l825kNcY5Gf5AmpNTC5ov/N4Z18XNNNBw5Ls6vyFFDKak/H0UHw=="}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:51.944631 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-2d4f314e-b274-48a6-933d-fbe6db63af6e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Getting quotas for project fde0e661bd5646bab91b5e6b623a2e7e. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:19:51.949899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-2d4f314e-b274-48a6-933d-fbe6db63af6e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Getting quotas for user 2f141efe3bb74587b5ba13f0cd5d89db and project fde0e661bd5646bab91b5e6b623a2e7e. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:19:52.174549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-2d4f314e-b274-48a6-933d-fbe6db63af6e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.850666 Aug 26 06:19:52.175476 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 214/404] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 06:19:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:19:52.564926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1c2a59df-cea4-4351-abce-129f4745d714 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:52.565561 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1c2a59df-cea4-4351-abce-129f4745d714 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:52.586331 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c2a59df-cea4-4351-abce-129f4745d714 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:52.586895 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c2a59df-cea4-4351-abce-129f4745d714 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:52.587339 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c2a59df-cea4-4351-abce-129f4745d714 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:52.588256 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c2a59df-cea4-4351-abce-129f4745d714 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:52.588881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c2a59df-cea4-4351-abce-129f4745d714 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:52.589473 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c2a59df-cea4-4351-abce-129f4745d714 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:52.836391 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1c2a59df-cea4-4351-abce-129f4745d714 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:52.844425 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1c2a59df-cea4-4351-abce-129f4745d714 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.284167 Aug 26 06:19:52.850963 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 191/405] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:52 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:53.869550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ce9b30c5-8677-4533-9029-817c21b57d8d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:53.871921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ce9b30c5-8677-4533-9029-817c21b57d8d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:53.886512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce9b30c5-8677-4533-9029-817c21b57d8d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:53.893150 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce9b30c5-8677-4533-9029-817c21b57d8d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:53.893715 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce9b30c5-8677-4533-9029-817c21b57d8d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:53.905483 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce9b30c5-8677-4533-9029-817c21b57d8d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:53.922077 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce9b30c5-8677-4533-9029-817c21b57d8d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:53.925773 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ce9b30c5-8677-4533-9029-817c21b57d8d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:54.182508 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ce9b30c5-8677-4533-9029-817c21b57d8d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:54.195451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ce9b30c5-8677-4533-9029-817c21b57d8d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.332317 Aug 26 06:19:54.211223 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 215/406] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:53 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:55.219306 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-91a3ee6e-d390-44a1-91cb-27cf7e6d0fe0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:55.219727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-91a3ee6e-d390-44a1-91cb-27cf7e6d0fe0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:55.227279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-91a3ee6e-d390-44a1-91cb-27cf7e6d0fe0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:55.227777 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-91a3ee6e-d390-44a1-91cb-27cf7e6d0fe0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:55.228215 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-91a3ee6e-d390-44a1-91cb-27cf7e6d0fe0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:55.228978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-91a3ee6e-d390-44a1-91cb-27cf7e6d0fe0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:55.229607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-91a3ee6e-d390-44a1-91cb-27cf7e6d0fe0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:55.230059 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-91a3ee6e-d390-44a1-91cb-27cf7e6d0fe0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:55.397231 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-91a3ee6e-d390-44a1-91cb-27cf7e6d0fe0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:55.405764 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-91a3ee6e-d390-44a1-91cb-27cf7e6d0fe0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.191347 Aug 26 06:19:55.406707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 192/407] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:55 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:56.431975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4443a038-011a-4c0d-8b38-651585eb338b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:56.432765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4443a038-011a-4c0d-8b38-651585eb338b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:56.438962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4443a038-011a-4c0d-8b38-651585eb338b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:56.439446 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4443a038-011a-4c0d-8b38-651585eb338b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:56.439881 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4443a038-011a-4c0d-8b38-651585eb338b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:56.440576 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4443a038-011a-4c0d-8b38-651585eb338b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:56.441025 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4443a038-011a-4c0d-8b38-651585eb338b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:56.441450 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4443a038-011a-4c0d-8b38-651585eb338b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:56.646031 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4443a038-011a-4c0d-8b38-651585eb338b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:56.655004 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4443a038-011a-4c0d-8b38-651585eb338b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.227073 Aug 26 06:19:56.655934 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 216/408] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:56 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:56.844029 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-12b6eff6-0f93-4416-a409-07497c16323f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Action: 'create', calling method: .version_select at 0x7f2f09181820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1886145305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2GiwBuOe51nv3AboihD+arC6bb58StEZPTpaM6IovAa/n3CyqgTgBvM24Qbi7KyT1oFB6j9Ru6NlRtxwgvptOppPV72lnYLehJg2Wkvom3/rIANUxHxyT8wgeKQjcKBw=="}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:56.876156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-12b6eff6-0f93-4416-a409-07497c16323f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Getting quotas for project 01817da1260c41b4abe6f02b11c66232. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:19:56.882608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-12b6eff6-0f93-4416-a409-07497c16323f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Getting quotas for user 61318fafe2a1469c884b5290fe4ba366 and project 01817da1260c41b4abe6f02b11c66232. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:19:57.069414 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-12b6eff6-0f93-4416-a409-07497c16323f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.234226 Aug 26 06:19:57.074766 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 193/409] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 06:19:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:19:57.236336 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1323563577", "imageRef": "ca207745-75e4-43c7-8a2a-c42b8b935b7a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1886145305", "networks": [{"uuid": "e160e0e8-e0fd-4af5-b357-0de9a51426d2"}]}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:57.249428 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2eda39f9-cef0-4d6f-9d53-bda6c387b531 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:19:57.250483 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2eda39f9-cef0-4d6f-9d53-bda6c387b531 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:57.259425 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eda39f9-cef0-4d6f-9d53-bda6c387b531 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:57.260579 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eda39f9-cef0-4d6f-9d53-bda6c387b531 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:57.261292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eda39f9-cef0-4d6f-9d53-bda6c387b531 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:57.263290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eda39f9-cef0-4d6f-9d53-bda6c387b531 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:57.264045 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eda39f9-cef0-4d6f-9d53-bda6c387b531 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:57.264923 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eda39f9-cef0-4d6f-9d53-bda6c387b531 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:57.294890 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-2eda39f9-cef0-4d6f-9d53-bda6c387b531 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lazy-loading 'flavor' on Instance uuid ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:19:57.305458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.network.neutron [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] validate_networks() for [('e160e0e8-e0fd-4af5-b357-0de9a51426d2', None, None, None, None, None)] {{(pid=121343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:19:57.836025 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Flavor limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:19:57.836640 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Image limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:19:57.836906 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Flavor pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:19:57.837369 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Image pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:19:57.837783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:19:57.847861 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:57.849256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:57.849414 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:57.850159 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:57.850646 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:57.851149 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:57.875282 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Getting quotas for project 01817da1260c41b4abe6f02b11c66232. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:19:57.884510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Getting quotas for user 61318fafe2a1469c884b5290fe4ba366 and project 01817da1260c41b4abe6f02b11c66232. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:19:57.901528 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Going to run 1 instances... {{(pid=121343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:19:57.904723 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca207745-75e4-43c7-8a2a-c42b8b935b7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:19:58.151263 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-05e63d27-a75b-4c99-9288-1926c3d5176b tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.918961 Aug 26 06:19:58.151920 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 217/410] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:19:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:19:58.156773 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-304d42ba-e170-4405-b4e3-c6c4e9d99f05 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:58.157398 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-304d42ba-e170-4405-b4e3-c6c4e9d99f05 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:58.165121 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-304d42ba-e170-4405-b4e3-c6c4e9d99f05 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:58.165619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-304d42ba-e170-4405-b4e3-c6c4e9d99f05 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:58.166057 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-304d42ba-e170-4405-b4e3-c6c4e9d99f05 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:58.166819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-304d42ba-e170-4405-b4e3-c6c4e9d99f05 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:58.167290 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-304d42ba-e170-4405-b4e3-c6c4e9d99f05 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:58.167816 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-304d42ba-e170-4405-b4e3-c6c4e9d99f05 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:58.393020 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-304d42ba-e170-4405-b4e3-c6c4e9d99f05 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:58.407930 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-304d42ba-e170-4405-b4e3-c6c4e9d99f05 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.254574 Aug 26 06:19:58.409004 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 218/411] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:58 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:58.417554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-54aeab2e-f7f5-405b-a0e6-0615e985f61c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:58.419043 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-54aeab2e-f7f5-405b-a0e6-0615e985f61c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:58.495709 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-54aeab2e-f7f5-405b-a0e6-0615e985f61c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:58.509237 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-54aeab2e-f7f5-405b-a0e6-0615e985f61c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1259 microversion: 2.1 time: 0.098137 Aug 26 06:19:58.510438 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 219/412] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:58 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1259 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:58.638010 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2eda39f9-cef0-4d6f-9d53-bda6c387b531 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "POST /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/action" status: 202 len: 0 microversion: 2.20 time: 1.392169 Aug 26 06:19:58.639074 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 194/413] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 26 06:19:57 2022] POST /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/action => generated 0 bytes in 1395 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:19:58.649684 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:58.650299 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:58.659356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:58.659863 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:58.660367 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:58.662811 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:58.662811 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:58.667246 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:58.908700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:58.922924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:58.924688 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:58.925876 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-24c1affe-1ca4-4146-9fee-18e69cec17bb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.281453 Aug 26 06:19:58.927073 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 220/414] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:19:58 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:19:59.434120 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-11eb7e4b-1cc2-4458-8340-d87f1228b276 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:59.434858 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-11eb7e4b-1cc2-4458-8340-d87f1228b276 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:59.443274 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11eb7e4b-1cc2-4458-8340-d87f1228b276 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:59.444134 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11eb7e4b-1cc2-4458-8340-d87f1228b276 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:59.444733 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11eb7e4b-1cc2-4458-8340-d87f1228b276 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:59.446087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11eb7e4b-1cc2-4458-8340-d87f1228b276 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:59.446612 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11eb7e4b-1cc2-4458-8340-d87f1228b276 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:59.447197 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-11eb7e4b-1cc2-4458-8340-d87f1228b276 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:59.543749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ba2c9ee2-6698-41bf-835d-bd2ff32fce62 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:59.543919 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ba2c9ee2-6698-41bf-835d-bd2ff32fce62 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:59.605021 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ba2c9ee2-6698-41bf-835d-bd2ff32fce62 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:59.614295 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-11eb7e4b-1cc2-4458-8340-d87f1228b276 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:19:59.616830 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ba2c9ee2-6698-41bf-835d-bd2ff32fce62 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1259 microversion: 2.1 time: 0.077099 Aug 26 06:19:59.617871 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 221/415] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:59 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1259 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:19:59.625235 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-11eb7e4b-1cc2-4458-8340-d87f1228b276 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.196585 Aug 26 06:19:59.626151 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 195/416] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:19:59 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:19:59.956877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:19:59.959689 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:19:59.975069 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:59.975898 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:59.979640 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:19:59.979640 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:19:59.979640 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:19:59.979640 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:00.204462 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:00.214812 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:00.216293 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:00.217708 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-43087772-d366-4053-ad12-65967441eab4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.270468 Aug 26 06:20:00.222671 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 222/417] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:19:59 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:00.654260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-33ba2c2d-d252-4df0-8075-c61cebf3ea77 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:00.656809 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-33ba2c2d-d252-4df0-8075-c61cebf3ea77 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:00.663618 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ed424a21-1804-4466-9bb6-99a8efe63aa1 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:00.664863 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ed424a21-1804-4466-9bb6-99a8efe63aa1 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:00.674058 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed424a21-1804-4466-9bb6-99a8efe63aa1 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:00.674660 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed424a21-1804-4466-9bb6-99a8efe63aa1 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:00.675137 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed424a21-1804-4466-9bb6-99a8efe63aa1 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:00.675851 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed424a21-1804-4466-9bb6-99a8efe63aa1 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:00.678200 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed424a21-1804-4466-9bb6-99a8efe63aa1 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:00.678810 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed424a21-1804-4466-9bb6-99a8efe63aa1 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:00.740279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-33ba2c2d-d252-4df0-8075-c61cebf3ea77 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:00.753569 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-33ba2c2d-d252-4df0-8075-c61cebf3ea77 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1259 microversion: 2.1 time: 0.108208 Aug 26 06:20:00.754398 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 196/418] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:00 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1259 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:00.884701 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ed424a21-1804-4466-9bb6-99a8efe63aa1 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:00.893689 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ed424a21-1804-4466-9bb6-99a8efe63aa1 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.239325 Aug 26 06:20:00.894303 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 223/419] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:00 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:01.162833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a7d26b98-2bdc-4417-8848-d1a82b4a644e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:01.163796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a7d26b98-2bdc-4417-8848-d1a82b4a644e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:01.176904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7d26b98-2bdc-4417-8848-d1a82b4a644e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:01.178015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7d26b98-2bdc-4417-8848-d1a82b4a644e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:01.178888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7d26b98-2bdc-4417-8848-d1a82b4a644e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:01.180276 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7d26b98-2bdc-4417-8848-d1a82b4a644e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:01.181140 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7d26b98-2bdc-4417-8848-d1a82b4a644e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:01.181927 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7d26b98-2bdc-4417-8848-d1a82b4a644e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:01.247741 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:01.249435 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:01.266091 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:01.267684 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:01.268878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:01.271062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:01.272455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:01.273589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:01.399779 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-a7d26b98-2bdc-4417-8848-d1a82b4a644e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lazy-loading 'services' on Instance uuid 40a23686-df31-4e61-879f-e1b1eaaef0ea {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:01.518292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:01.540243 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:01.553298 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:01.553298 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-fd8bb318-6ea6-4140-86ae-c09bcce1be9a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.304608 Aug 26 06:20:01.553298 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 224/420] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:01 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:01.596126 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-5447c35f-dee1-4730-8bfe-84171fd5fa12 req-f5d3e653-df1c-49cd-a07e-839a397d1e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1745aea6-2b4b-48cb-82d5-3c6f62c9196d", "name": "network-vif-plugged", "status": "completed", "tag": "56fec6a1-e21d-4fe6-ba05-e70da56fde9b"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:01.607910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-5447c35f-dee1-4730-8bfe-84171fd5fa12 req-f5d3e653-df1c-49cd-a07e-839a397d1e51 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:01.608400 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-5447c35f-dee1-4730-8bfe-84171fd5fa12 req-f5d3e653-df1c-49cd-a07e-839a397d1e51 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:01.608843 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-5447c35f-dee1-4730-8bfe-84171fd5fa12 req-f5d3e653-df1c-49cd-a07e-839a397d1e51 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:01.623222 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-5447c35f-dee1-4730-8bfe-84171fd5fa12 req-f5d3e653-df1c-49cd-a07e-839a397d1e51 service nova] Creating event network-vif-plugged:56fec6a1-e21d-4fe6-ba05-e70da56fde9b for instance 1745aea6-2b4b-48cb-82d5-3c6f62c9196d on hv-cinder-85391 Aug 26 06:20:01.629862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-5447c35f-dee1-4730-8bfe-84171fd5fa12 req-f5d3e653-df1c-49cd-a07e-839a397d1e51 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039427 Aug 26 06:20:01.630709 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 225/421] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:20:01.794473 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-76f1a90c-22e9-44bc-9bf0-68e979e3cc56 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:01.799640 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-76f1a90c-22e9-44bc-9bf0-68e979e3cc56 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:01.815516 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76f1a90c-22e9-44bc-9bf0-68e979e3cc56 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:01.816009 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76f1a90c-22e9-44bc-9bf0-68e979e3cc56 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:01.816462 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76f1a90c-22e9-44bc-9bf0-68e979e3cc56 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:01.818036 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76f1a90c-22e9-44bc-9bf0-68e979e3cc56 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:01.818829 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76f1a90c-22e9-44bc-9bf0-68e979e3cc56 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:01.819561 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-76f1a90c-22e9-44bc-9bf0-68e979e3cc56 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:01.921830 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-76f1a90c-22e9-44bc-9bf0-68e979e3cc56 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:01.932641 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-76f1a90c-22e9-44bc-9bf0-68e979e3cc56 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1255 microversion: 2.1 time: 0.155089 Aug 26 06:20:01.933625 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 226/422] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:01 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1255 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:01.939196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e58f9cc1-d855-4924-a107-b0c0a1ccf50b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:01.940114 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e58f9cc1-d855-4924-a107-b0c0a1ccf50b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:01.949532 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e58f9cc1-d855-4924-a107-b0c0a1ccf50b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:01.950048 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e58f9cc1-d855-4924-a107-b0c0a1ccf50b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:01.950503 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e58f9cc1-d855-4924-a107-b0c0a1ccf50b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:01.951474 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e58f9cc1-d855-4924-a107-b0c0a1ccf50b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:01.951956 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e58f9cc1-d855-4924-a107-b0c0a1ccf50b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:01.952543 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e58f9cc1-d855-4924-a107-b0c0a1ccf50b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:02.033741 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a7d26b98-2bdc-4417-8848-d1a82b4a644e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "DELETE /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea/os-volume_attachments/e602c6a7-302d-4202-9eb4-659b70fa9ab5" status: 202 len: 0 microversion: 2.1 time: 0.870922 Aug 26 06:20:02.036373 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 197/423] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:20:01 2022] DELETE /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea/os-volume_attachments/e602c6a7-302d-4202-9eb4-659b70fa9ab5 => generated 0 bytes in 884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:20:02.207988 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e58f9cc1-d855-4924-a107-b0c0a1ccf50b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:02.220846 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e58f9cc1-d855-4924-a107-b0c0a1ccf50b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.285598 Aug 26 06:20:02.221752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 227/424] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:01 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:02.580421 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:02.581269 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:02.589853 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:02.590453 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:02.591020 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:02.591838 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:02.592382 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:02.592896 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:02.772663 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:02.781418 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:02.782884 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:02.784029 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-af55280a-aefa-41af-b144-7672e7fc48e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.211825 Aug 26 06:20:02.784584 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 198/425] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:02 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:20:02.962344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-abd32632-013c-44de-9dc1-bfcc51280fd9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:02.962975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-abd32632-013c-44de-9dc1-bfcc51280fd9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:02.969501 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-abd32632-013c-44de-9dc1-bfcc51280fd9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:02.969989 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-abd32632-013c-44de-9dc1-bfcc51280fd9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:02.970419 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-abd32632-013c-44de-9dc1-bfcc51280fd9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:02.971137 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-abd32632-013c-44de-9dc1-bfcc51280fd9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:02.971584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-abd32632-013c-44de-9dc1-bfcc51280fd9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:02.972215 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-abd32632-013c-44de-9dc1-bfcc51280fd9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:03.045426 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-abd32632-013c-44de-9dc1-bfcc51280fd9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:03.060927 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-abd32632-013c-44de-9dc1-bfcc51280fd9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1311 microversion: 2.1 time: 0.100499 Aug 26 06:20:03.060927 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 228/426] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:02 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:03.245579 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2c7cf21c-9b14-4630-a545-acc9872624ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:03.246234 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2c7cf21c-9b14-4630-a545-acc9872624ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:03.252496 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c7cf21c-9b14-4630-a545-acc9872624ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:03.252972 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c7cf21c-9b14-4630-a545-acc9872624ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:03.253499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c7cf21c-9b14-4630-a545-acc9872624ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:03.254096 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c7cf21c-9b14-4630-a545-acc9872624ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:03.254763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c7cf21c-9b14-4630-a545-acc9872624ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:03.255215 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c7cf21c-9b14-4630-a545-acc9872624ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:03.412258 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2c7cf21c-9b14-4630-a545-acc9872624ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:03.423422 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2c7cf21c-9b14-4630-a545-acc9872624ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.181598 Aug 26 06:20:03.424013 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 199/427] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:03 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:03.808950 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:03.809551 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:03.818158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:03.823716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:03.823716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:03.823716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:03.823716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:03.824265 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:03.999407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:04.008943 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:04.010798 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:04.012121 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bda154a8-5a23-4c5b-b124-e8e96411f738 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.207097 Aug 26 06:20:04.012684 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 229/428] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:03 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:20:04.083688 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5e3dc5f9-ad03-4b24-a86e-dc1e8bf18498 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:04.084834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5e3dc5f9-ad03-4b24-a86e-dc1e8bf18498 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:04.092639 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e3dc5f9-ad03-4b24-a86e-dc1e8bf18498 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:04.093630 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e3dc5f9-ad03-4b24-a86e-dc1e8bf18498 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:04.094430 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e3dc5f9-ad03-4b24-a86e-dc1e8bf18498 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:04.095644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e3dc5f9-ad03-4b24-a86e-dc1e8bf18498 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:04.096456 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e3dc5f9-ad03-4b24-a86e-dc1e8bf18498 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:04.097228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e3dc5f9-ad03-4b24-a86e-dc1e8bf18498 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:04.170200 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5e3dc5f9-ad03-4b24-a86e-dc1e8bf18498 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:04.174184 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:04.178962 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5e3dc5f9-ad03-4b24-a86e-dc1e8bf18498 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1311 microversion: 2.1 time: 0.102564 Aug 26 06:20:04.179537 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 200/429] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:04 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:04.446465 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4665be6f-c412-47c2-bd39-393df68d8930 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:04.447084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4665be6f-c412-47c2-bd39-393df68d8930 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:04.453325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4665be6f-c412-47c2-bd39-393df68d8930 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:04.453823 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4665be6f-c412-47c2-bd39-393df68d8930 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:04.454253 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4665be6f-c412-47c2-bd39-393df68d8930 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:04.454979 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4665be6f-c412-47c2-bd39-393df68d8930 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:04.455426 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4665be6f-c412-47c2-bd39-393df68d8930 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:04.455835 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4665be6f-c412-47c2-bd39-393df68d8930 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:04.459336 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=100 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:04.606355 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4665be6f-c412-47c2-bd39-393df68d8930 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:04.615444 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4665be6f-c412-47c2-bd39-393df68d8930 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.173890 Aug 26 06:20:04.616720 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 230/430] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:04 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:05.038093 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:05.038093 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:05.045004 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:05.045514 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:05.047404 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:05.047404 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:05.047404 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:05.047848 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:05.202685 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-409b73e6-22be-4931-81ad-f30c2e3543e9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:05.204049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-409b73e6-22be-4931-81ad-f30c2e3543e9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:05.211288 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-409b73e6-22be-4931-81ad-f30c2e3543e9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:05.211780 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-409b73e6-22be-4931-81ad-f30c2e3543e9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:05.212267 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-409b73e6-22be-4931-81ad-f30c2e3543e9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:05.213201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-409b73e6-22be-4931-81ad-f30c2e3543e9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:05.213768 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-409b73e6-22be-4931-81ad-f30c2e3543e9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:05.214528 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-409b73e6-22be-4931-81ad-f30c2e3543e9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:05.231633 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:05.243495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:05.245077 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:05.246466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7ad09f3a-dbd7-4bcb-86cf-f58679731373 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.214126 Aug 26 06:20:05.247230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 201/431] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:05 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:05.304117 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-409b73e6-22be-4931-81ad-f30c2e3543e9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:05.318168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-409b73e6-22be-4931-81ad-f30c2e3543e9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1311 microversion: 2.1 time: 0.120038 Aug 26 06:20:05.319642 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 231/432] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:05 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:05.643005 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5d997568-6cc8-49d6-a4f4-28d770dabf29 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:05.643005 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5d997568-6cc8-49d6-a4f4-28d770dabf29 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:05.644753 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5d997568-6cc8-49d6-a4f4-28d770dabf29 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:05.645484 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5d997568-6cc8-49d6-a4f4-28d770dabf29 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:05.645916 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5d997568-6cc8-49d6-a4f4-28d770dabf29 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:05.646657 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5d997568-6cc8-49d6-a4f4-28d770dabf29 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:05.647143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5d997568-6cc8-49d6-a4f4-28d770dabf29 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:05.647609 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5d997568-6cc8-49d6-a4f4-28d770dabf29 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:05.819507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5d997568-6cc8-49d6-a4f4-28d770dabf29 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:05.828210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5d997568-6cc8-49d6-a4f4-28d770dabf29 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.194919 Aug 26 06:20:05.829068 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 202/433] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:05 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:06.272262 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:06.272886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:06.279478 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:06.280047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:06.280483 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:06.281178 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:06.281629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:06.282051 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:06.354052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-bbbc03a0-98a5-4a08-a888-8621c2c1340e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:06.355722 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-bbbc03a0-98a5-4a08-a888-8621c2c1340e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:06.363056 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bbbc03a0-98a5-4a08-a888-8621c2c1340e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:06.363728 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bbbc03a0-98a5-4a08-a888-8621c2c1340e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:06.364931 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bbbc03a0-98a5-4a08-a888-8621c2c1340e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:06.365979 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bbbc03a0-98a5-4a08-a888-8621c2c1340e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:06.366474 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bbbc03a0-98a5-4a08-a888-8621c2c1340e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:06.366931 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bbbc03a0-98a5-4a08-a888-8621c2c1340e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:06.479825 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-bbbc03a0-98a5-4a08-a888-8621c2c1340e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:06.484579 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-bbbc03a0-98a5-4a08-a888-8621c2c1340e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1311 microversion: 2.1 time: 0.134132 Aug 26 06:20:06.487855 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 203/434] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:06 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:06.509753 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:06.521508 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:06.523025 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:06.524193 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-116f2df6-5a16-4501-bbc6-d8e4a6b253e0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.255922 Aug 26 06:20:06.524741 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 232/435] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:06 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:06.851733 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-68efbeb5-bd0e-420c-bec7-c0958972db4a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:06.852641 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-68efbeb5-bd0e-420c-bec7-c0958972db4a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:06.859827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68efbeb5-bd0e-420c-bec7-c0958972db4a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:06.860649 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68efbeb5-bd0e-420c-bec7-c0958972db4a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:06.861334 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68efbeb5-bd0e-420c-bec7-c0958972db4a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:06.862331 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68efbeb5-bd0e-420c-bec7-c0958972db4a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:06.863138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68efbeb5-bd0e-420c-bec7-c0958972db4a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:06.863796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68efbeb5-bd0e-420c-bec7-c0958972db4a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:06.869163 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-dc30caf9-2842-4c19-b3e7-9c8b46dcc50c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:06.869919 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-dc30caf9-2842-4c19-b3e7-9c8b46dcc50c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:06.878074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc30caf9-2842-4c19-b3e7-9c8b46dcc50c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:06.878565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc30caf9-2842-4c19-b3e7-9c8b46dcc50c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:06.879074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc30caf9-2842-4c19-b3e7-9c8b46dcc50c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:06.880309 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc30caf9-2842-4c19-b3e7-9c8b46dcc50c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:06.880820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc30caf9-2842-4c19-b3e7-9c8b46dcc50c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:06.881296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dc30caf9-2842-4c19-b3e7-9c8b46dcc50c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:07.064934 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-68efbeb5-bd0e-420c-bec7-c0958972db4a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:07.076350 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-68efbeb5-bd0e-420c-bec7-c0958972db4a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1314 microversion: 2.1 time: 0.228448 Aug 26 06:20:07.077150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 204/436] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:06 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:07.081600 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-dc30caf9-2842-4c19-b3e7-9c8b46dcc50c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lazy-loading 'services' on Instance uuid c0dda9da-e7bd-4a7d-b807-a2074ccbe208 {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:07.509598 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-96df6096-8046-49bb-a8cd-f46a8a50ca4e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:07.510297 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-96df6096-8046-49bb-a8cd-f46a8a50ca4e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:07.519275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-96df6096-8046-49bb-a8cd-f46a8a50ca4e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:07.519572 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-96df6096-8046-49bb-a8cd-f46a8a50ca4e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:07.519991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-96df6096-8046-49bb-a8cd-f46a8a50ca4e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:07.520830 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-96df6096-8046-49bb-a8cd-f46a8a50ca4e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:07.521295 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-96df6096-8046-49bb-a8cd-f46a8a50ca4e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:07.521730 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-96df6096-8046-49bb-a8cd-f46a8a50ca4e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:07.606768 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-96df6096-8046-49bb-a8cd-f46a8a50ca4e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:07.623450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-96df6096-8046-49bb-a8cd-f46a8a50ca4e tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1319 microversion: 2.1 time: 0.118094 Aug 26 06:20:07.635408 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 205/437] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:07 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1319 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:07.642027 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-dc30caf9-2842-4c19-b3e7-9c8b46dcc50c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/os-volume_attachments/c321585d-7090-43ec-91ed-4209a1e3326f" status: 202 len: 0 microversion: 2.1 time: 0.777895 Aug 26 06:20:07.651023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 233/438] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:20:06 2022] DELETE /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/os-volume_attachments/c321585d-7090-43ec-91ed-4209a1e3326f => generated 0 bytes in 782 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:20:07.654995 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:07.655617 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:07.676902 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:07.677826 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:07.678039 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d39c645b-f399-4544-8b1d-c409c7ea3cb9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:07.678451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d39c645b-f399-4544-8b1d-c409c7ea3cb9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:07.686654 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d39c645b-f399-4544-8b1d-c409c7ea3cb9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:07.687511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d39c645b-f399-4544-8b1d-c409c7ea3cb9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:07.687838 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:07.688390 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d39c645b-f399-4544-8b1d-c409c7ea3cb9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:07.688672 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:07.689154 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:07.689632 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:07.689786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d39c645b-f399-4544-8b1d-c409c7ea3cb9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:07.690659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d39c645b-f399-4544-8b1d-c409c7ea3cb9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:07.690822 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d39c645b-f399-4544-8b1d-c409c7ea3cb9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:07.738065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d39c645b-f399-4544-8b1d-c409c7ea3cb9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Going to try to terminate instance {{(pid=121343) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:20:07.860779 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:08.000462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:08.013088 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:08.015316 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:08.016783 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b2f5129b-f15b-4b42-9e33-12dbee161077 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.379825 Aug 26 06:20:08.017481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 206/439] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:07 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:08.111623 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-eee33080-7912-4617-bce8-a49bc2efa817 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:08.112769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-eee33080-7912-4617-bce8-a49bc2efa817 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:08.121035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eee33080-7912-4617-bce8-a49bc2efa817 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:08.121809 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eee33080-7912-4617-bce8-a49bc2efa817 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:08.122376 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eee33080-7912-4617-bce8-a49bc2efa817 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:08.123431 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eee33080-7912-4617-bce8-a49bc2efa817 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:08.124137 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eee33080-7912-4617-bce8-a49bc2efa817 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:08.124687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eee33080-7912-4617-bce8-a49bc2efa817 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:08.334214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-eee33080-7912-4617-bce8-a49bc2efa817 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:08.363016 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-eee33080-7912-4617-bce8-a49bc2efa817 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1498 microversion: 2.1 time: 0.251690 Aug 26 06:20:08.363016 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 207/440] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:08 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:08.455659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d39c645b-f399-4544-8b1d-c409c7ea3cb9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "DELETE /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 204 len: 0 microversion: 2.1 time: 0.782204 Aug 26 06:20:08.456661 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 234/441] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:20:07 2022] DELETE /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 0 bytes in 785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:20:08.468676 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-432be298-885d-470e-8f1c-87dc085d106b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:08.469333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-432be298-885d-470e-8f1c-87dc085d106b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:08.484574 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-432be298-885d-470e-8f1c-87dc085d106b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:08.485086 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-432be298-885d-470e-8f1c-87dc085d106b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:08.485532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-432be298-885d-470e-8f1c-87dc085d106b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:08.499763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-432be298-885d-470e-8f1c-87dc085d106b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:08.500261 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-432be298-885d-470e-8f1c-87dc085d106b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:08.500706 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-432be298-885d-470e-8f1c-87dc085d106b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:08.669153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4e8dc42b-d55e-4b30-afc9-9796e67770fd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:08.670090 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4e8dc42b-d55e-4b30-afc9-9796e67770fd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:08.678714 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e8dc42b-d55e-4b30-afc9-9796e67770fd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:08.679249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e8dc42b-d55e-4b30-afc9-9796e67770fd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:08.680185 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e8dc42b-d55e-4b30-afc9-9796e67770fd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:08.681558 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e8dc42b-d55e-4b30-afc9-9796e67770fd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:08.682309 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e8dc42b-d55e-4b30-afc9-9796e67770fd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:08.683153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e8dc42b-d55e-4b30-afc9-9796e67770fd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:08.717708 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-432be298-885d-470e-8f1c-87dc085d106b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:08.728428 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-432be298-885d-470e-8f1c-87dc085d106b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1512 microversion: 2.1 time: 0.265692 Aug 26 06:20:08.729033 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 208/442] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:08 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:09.051002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:09.052353 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:09.057534 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4e8dc42b-d55e-4b30-afc9-9796e67770fd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:09.064606 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:09.065761 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:09.066583 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:09.067370 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4e8dc42b-d55e-4b30-afc9-9796e67770fd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1317 microversion: 2.1 time: 0.402294 Aug 26 06:20:09.068977 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:09.069869 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:09.070576 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:09.079364 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 235/443] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:08 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:09.254104 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:09.263790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:09.265358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:09.266603 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8ce21690-a1d0-44ea-9fdc-249c1372debb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.223820 Aug 26 06:20:09.267192 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 209/444] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:09 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:09.749673 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9292f49f-86bf-4a20-8a54-f98ed3717b42 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:09.750510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9292f49f-86bf-4a20-8a54-f98ed3717b42 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:09.752761 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=14 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:09.759557 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9292f49f-86bf-4a20-8a54-f98ed3717b42 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:09.760042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9292f49f-86bf-4a20-8a54-f98ed3717b42 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:09.760483 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9292f49f-86bf-4a20-8a54-f98ed3717b42 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:09.761190 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9292f49f-86bf-4a20-8a54-f98ed3717b42 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:09.761750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9292f49f-86bf-4a20-8a54-f98ed3717b42 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:09.762059 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9292f49f-86bf-4a20-8a54-f98ed3717b42 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:09.958746 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9292f49f-86bf-4a20-8a54-f98ed3717b42 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:09.972074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9292f49f-86bf-4a20-8a54-f98ed3717b42 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1512 microversion: 2.1 time: 0.226077 Aug 26 06:20:09.972788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 236/445] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:09 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:10.044960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-90421101-15bd-4437-940f-dd0f40365cae tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:10.045827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-90421101-15bd-4437-940f-dd0f40365cae tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:10.049853 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:10.058512 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90421101-15bd-4437-940f-dd0f40365cae tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:10.059471 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90421101-15bd-4437-940f-dd0f40365cae tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:10.060253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90421101-15bd-4437-940f-dd0f40365cae tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:10.061462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90421101-15bd-4437-940f-dd0f40365cae tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:10.062257 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90421101-15bd-4437-940f-dd0f40365cae tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:10.063073 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90421101-15bd-4437-940f-dd0f40365cae tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:10.092792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bb1734bd-142c-42f2-9b4b-2bb4ba5c9864 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:10.094138 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-bb1734bd-142c-42f2-9b4b-2bb4ba5c9864 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:10.104494 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb1734bd-142c-42f2-9b4b-2bb4ba5c9864 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:10.105311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb1734bd-142c-42f2-9b4b-2bb4ba5c9864 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:10.105994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb1734bd-142c-42f2-9b4b-2bb4ba5c9864 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:10.107161 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb1734bd-142c-42f2-9b4b-2bb4ba5c9864 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:10.107896 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb1734bd-142c-42f2-9b4b-2bb4ba5c9864 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:10.108161 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-90421101-15bd-4437-940f-dd0f40365cae tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:20:10.108599 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb1734bd-142c-42f2-9b4b-2bb4ba5c9864 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:10.284699 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bb1734bd-142c-42f2-9b4b-2bb4ba5c9864 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:10.293617 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bb1734bd-142c-42f2-9b4b-2bb4ba5c9864 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.205144 Aug 26 06:20:10.296648 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 237/446] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:10 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:10.299089 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:10.299684 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:10.306612 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:10.308393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:10.308844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:10.309572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:10.310230 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:10.310863 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:10.505762 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:10.515505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:10.517052 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:10.519087 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bc39fa09-5752-4dc9-98aa-8707327ecc2d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.223700 Aug 26 06:20:10.521913 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 238/447] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:10 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:10.755521 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=6 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:10.793434 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-90421101-15bd-4437-940f-dd0f40365cae tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 204 len: 0 microversion: 2.1 time: 0.755227 Aug 26 06:20:10.794250 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 210/448] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:20:10 2022] DELETE /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 0 bytes in 758 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:20:10.804789 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-65b11576-fa47-4f52-9466-dc61133878f9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:10.805620 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-65b11576-fa47-4f52-9466-dc61133878f9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:10.813649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65b11576-fa47-4f52-9466-dc61133878f9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:10.814212 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65b11576-fa47-4f52-9466-dc61133878f9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:10.814754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65b11576-fa47-4f52-9466-dc61133878f9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:10.816001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65b11576-fa47-4f52-9466-dc61133878f9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:10.816001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65b11576-fa47-4f52-9466-dc61133878f9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:10.816307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65b11576-fa47-4f52-9466-dc61133878f9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:11.008074 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a7c4c6e7-058f-49f5-9a94-3f1ad169f604 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:11.008802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a7c4c6e7-058f-49f5-9a94-3f1ad169f604 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:11.027154 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7c4c6e7-058f-49f5-9a94-3f1ad169f604 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:11.031762 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7c4c6e7-058f-49f5-9a94-3f1ad169f604 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:11.031762 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7c4c6e7-058f-49f5-9a94-3f1ad169f604 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:11.035606 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7c4c6e7-058f-49f5-9a94-3f1ad169f604 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:11.036061 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7c4c6e7-058f-49f5-9a94-3f1ad169f604 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:11.040717 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a7c4c6e7-058f-49f5-9a94-3f1ad169f604 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:11.109727 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-65b11576-fa47-4f52-9466-dc61133878f9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:11.120927 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-65b11576-fa47-4f52-9466-dc61133878f9 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1504 microversion: 2.1 time: 0.321471 Aug 26 06:20:11.121516 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 239/449] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:10 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:11.282500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a7c4c6e7-058f-49f5-9a94-3f1ad169f604 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:11.291459 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a7c4c6e7-058f-49f5-9a94-3f1ad169f604 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1512 microversion: 2.1 time: 0.290779 Aug 26 06:20:11.296749 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 211/450] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:10 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:11.327523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-36049add-1b8c-4810-afd7-fc2a0499a609 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:11.327909 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-36049add-1b8c-4810-afd7-fc2a0499a609 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:11.335061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36049add-1b8c-4810-afd7-fc2a0499a609 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:11.335573 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36049add-1b8c-4810-afd7-fc2a0499a609 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:11.336014 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36049add-1b8c-4810-afd7-fc2a0499a609 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:11.336720 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36049add-1b8c-4810-afd7-fc2a0499a609 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:11.337437 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36049add-1b8c-4810-afd7-fc2a0499a609 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:11.337887 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36049add-1b8c-4810-afd7-fc2a0499a609 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:11.553419 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:11.554761 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:11.565124 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:11.566347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:11.567847 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:11.569801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:11.570054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:11.571189 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:11.632051 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-36049add-1b8c-4810-afd7-fc2a0499a609 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:11.642579 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-36049add-1b8c-4810-afd7-fc2a0499a609 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.320738 Aug 26 06:20:11.643401 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 240/451] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:11 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:11.761679 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bb756581-19f8-44f3-84c7-a726a9a026a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:11.787443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb756581-19f8-44f3-84c7-a726a9a026a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:11.788847 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb756581-19f8-44f3-84c7-a726a9a026a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:11.790919 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb756581-19f8-44f3-84c7-a726a9a026a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:11.815142 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:11.826090 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:11.828509 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:11.830371 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2a64e5b9-9881-4310-a7c4-4e4b1b10a852 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.284557 Aug 26 06:20:11.838134 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 212/452] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:11 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:20:11.860462 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-bb756581-19f8-44f3-84c7-a726a9a026a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Going to try to stop instance {{(pid=121343) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 06:20:11.998517 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-23e42e85-229a-4331-b77c-55f4b7bcf5c4 req-4fd32c38-49e7-4dad-92fd-f3f54a8b97ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff368667-d93b-4b10-9606-09331ebb857c", "tag": "f4d37966-d902-4c07-9ee5-4be2e42d1714"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:12.009017 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-23e42e85-229a-4331-b77c-55f4b7bcf5c4 req-4fd32c38-49e7-4dad-92fd-f3f54a8b97ef service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:12.009500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-23e42e85-229a-4331-b77c-55f4b7bcf5c4 req-4fd32c38-49e7-4dad-92fd-f3f54a8b97ef service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:12.009955 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-23e42e85-229a-4331-b77c-55f4b7bcf5c4 req-4fd32c38-49e7-4dad-92fd-f3f54a8b97ef service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:12.023894 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-23e42e85-229a-4331-b77c-55f4b7bcf5c4 req-4fd32c38-49e7-4dad-92fd-f3f54a8b97ef service nova] Creating event network-changed:f4d37966-d902-4c07-9ee5-4be2e42d1714 for instance ff368667-d93b-4b10-9606-09331ebb857c on hv-cinder-85391 Aug 26 06:20:12.028908 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-23e42e85-229a-4331-b77c-55f4b7bcf5c4 req-4fd32c38-49e7-4dad-92fd-f3f54a8b97ef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034103 Aug 26 06:20:12.029505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 213/453] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:20:12.146520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4df1fe5e-bdc0-4888-9a85-2a599607ee58 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:12.147451 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4df1fe5e-bdc0-4888-9a85-2a599607ee58 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:12.154061 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4df1fe5e-bdc0-4888-9a85-2a599607ee58 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:12.154540 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4df1fe5e-bdc0-4888-9a85-2a599607ee58 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:12.154996 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4df1fe5e-bdc0-4888-9a85-2a599607ee58 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:12.155692 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4df1fe5e-bdc0-4888-9a85-2a599607ee58 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:12.156153 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4df1fe5e-bdc0-4888-9a85-2a599607ee58 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:12.156572 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4df1fe5e-bdc0-4888-9a85-2a599607ee58 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:12.387080 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4df1fe5e-bdc0-4888-9a85-2a599607ee58 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:12.400906 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4df1fe5e-bdc0-4888-9a85-2a599607ee58 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1504 microversion: 2.1 time: 0.260288 Aug 26 06:20:12.401868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 214/454] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:12 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:12.410001 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9340564b-c5b8-49ef-83c1-4b3db321e90f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:12.412125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9340564b-c5b8-49ef-83c1-4b3db321e90f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:12.435191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bb756581-19f8-44f3-84c7-a726a9a026a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "POST /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/action" status: 202 len: 0 microversion: 2.1 time: 0.681758 Aug 26 06:20:12.437633 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9340564b-c5b8-49ef-83c1-4b3db321e90f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:12.437803 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 241/455] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:20:11 2022] POST /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 06:20:12.437954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9340564b-c5b8-49ef-83c1-4b3db321e90f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:12.437954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9340564b-c5b8-49ef-83c1-4b3db321e90f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:12.439170 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9340564b-c5b8-49ef-83c1-4b3db321e90f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:12.440290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9340564b-c5b8-49ef-83c1-4b3db321e90f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:12.441214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9340564b-c5b8-49ef-83c1-4b3db321e90f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:12.453503 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e3d37ca0-4a08-4965-8bfe-4f0220b8fc47 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:12.454965 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e3d37ca0-4a08-4965-8bfe-4f0220b8fc47 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:12.458970 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:12.468476 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3d37ca0-4a08-4965-8bfe-4f0220b8fc47 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:12.472948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3d37ca0-4a08-4965-8bfe-4f0220b8fc47 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:12.474469 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3d37ca0-4a08-4965-8bfe-4f0220b8fc47 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:12.480331 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3d37ca0-4a08-4965-8bfe-4f0220b8fc47 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:12.481572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3d37ca0-4a08-4965-8bfe-4f0220b8fc47 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:12.482557 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3d37ca0-4a08-4965-8bfe-4f0220b8fc47 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:12.792532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9340564b-c5b8-49ef-83c1-4b3db321e90f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:12.801934 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e3d37ca0-4a08-4965-8bfe-4f0220b8fc47 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:12.818356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e3d37ca0-4a08-4965-8bfe-4f0220b8fc47 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1722 microversion: 2.1 time: 0.371937 Aug 26 06:20:12.820251 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 242/456] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:12 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1722 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:12.830273 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9340564b-c5b8-49ef-83c1-4b3db321e90f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1512 microversion: 2.1 time: 0.426458 Aug 26 06:20:12.841798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 215/457] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:12 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1512 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:12.842023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f4902d67-4e12-407e-9bfe-d345c80a8792 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:12.842023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f4902d67-4e12-407e-9bfe-d345c80a8792 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:12.845514 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f4902d67-4e12-407e-9bfe-d345c80a8792 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:12.846549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f4902d67-4e12-407e-9bfe-d345c80a8792 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:12.847159 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f4902d67-4e12-407e-9bfe-d345c80a8792 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:12.848548 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f4902d67-4e12-407e-9bfe-d345c80a8792 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:12.849159 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f4902d67-4e12-407e-9bfe-d345c80a8792 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:12.849768 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f4902d67-4e12-407e-9bfe-d345c80a8792 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:12.861241 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:12.863387 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:12.874481 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:12.881145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:12.881648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:12.894019 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:12.899190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:12.900062 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:12.900668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:12.936739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:13.204160 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:13.222075 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:13.232874 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:13.232874 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-48bcca57-d4e1-4fa7-baa5-dd8208336ef8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.370589 Aug 26 06:20:13.232874 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 216/458] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:12 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:13.384085 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f4902d67-4e12-407e-9bfe-d345c80a8792 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:13.416289 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f4902d67-4e12-407e-9bfe-d345c80a8792 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.593583 Aug 26 06:20:13.429973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 243/459] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:12 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:13.434120 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a47eeb8d-17d7-4d8d-99b9-2820f990864e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:13.434120 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a47eeb8d-17d7-4d8d-99b9-2820f990864e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:13.455361 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a47eeb8d-17d7-4d8d-99b9-2820f990864e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:13.458033 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a47eeb8d-17d7-4d8d-99b9-2820f990864e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:13.458509 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a47eeb8d-17d7-4d8d-99b9-2820f990864e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:13.472240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a47eeb8d-17d7-4d8d-99b9-2820f990864e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:13.472240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a47eeb8d-17d7-4d8d-99b9-2820f990864e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:13.472240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a47eeb8d-17d7-4d8d-99b9-2820f990864e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:13.753724 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a47eeb8d-17d7-4d8d-99b9-2820f990864e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:13.774050 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a47eeb8d-17d7-4d8d-99b9-2820f990864e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1504 microversion: 2.1 time: 0.346890 Aug 26 06:20:13.774050 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 217/460] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:13 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:13.859226 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7241e42c-dcb5-4137-93ab-ad2b56f8132f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:13.860230 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7241e42c-dcb5-4137-93ab-ad2b56f8132f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:13.878823 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9d9aa021-1706-4948-a27f-6ecadcc50cd0 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:13.880190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9d9aa021-1706-4948-a27f-6ecadcc50cd0 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:13.899360 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7241e42c-dcb5-4137-93ab-ad2b56f8132f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:13.900142 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7241e42c-dcb5-4137-93ab-ad2b56f8132f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:13.901190 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7241e42c-dcb5-4137-93ab-ad2b56f8132f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:13.908305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9d9aa021-1706-4948-a27f-6ecadcc50cd0 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:13.909715 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7241e42c-dcb5-4137-93ab-ad2b56f8132f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:13.911023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7241e42c-dcb5-4137-93ab-ad2b56f8132f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:13.911793 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7241e42c-dcb5-4137-93ab-ad2b56f8132f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:13.921426 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9d9aa021-1706-4948-a27f-6ecadcc50cd0 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:13.921716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9d9aa021-1706-4948-a27f-6ecadcc50cd0 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:13.922832 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9d9aa021-1706-4948-a27f-6ecadcc50cd0 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:13.923846 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9d9aa021-1706-4948-a27f-6ecadcc50cd0 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:13.924615 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9d9aa021-1706-4948-a27f-6ecadcc50cd0 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:14.044173 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9d9aa021-1706-4948-a27f-6ecadcc50cd0 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:14.067267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9d9aa021-1706-4948-a27f-6ecadcc50cd0 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1470 microversion: 2.1 time: 0.195803 Aug 26 06:20:14.068190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 218/461] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:13 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:14.247732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7241e42c-dcb5-4137-93ab-ad2b56f8132f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:14.262223 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7241e42c-dcb5-4137-93ab-ad2b56f8132f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.410694 Aug 26 06:20:14.270483 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:14.271126 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:14.281746 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 244/462] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:13 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:14.292195 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:14.294314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:14.299317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:14.301040 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:14.304140 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:14.305223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:14.326226 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-378faeae-8258-4004-912d-f94d43474f9c req-61209a68-0f78-436b-bd81-06ad32c05b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a23686-df31-4e61-879f-e1b1eaaef0ea", "name": "network-vif-deleted", "tag": "8f33f7d7-7e9a-4e62-9cc6-849887fde715"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:14.340920 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-378faeae-8258-4004-912d-f94d43474f9c req-61209a68-0f78-436b-bd81-06ad32c05b3e service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:14.341539 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-378faeae-8258-4004-912d-f94d43474f9c req-61209a68-0f78-436b-bd81-06ad32c05b3e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:14.342168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-378faeae-8258-4004-912d-f94d43474f9c req-61209a68-0f78-436b-bd81-06ad32c05b3e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:14.375583 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-378faeae-8258-4004-912d-f94d43474f9c req-61209a68-0f78-436b-bd81-06ad32c05b3e service nova] Creating event network-vif-deleted:8f33f7d7-7e9a-4e62-9cc6-849887fde715 for instance 40a23686-df31-4e61-879f-e1b1eaaef0ea on hv-cinder-85391 Aug 26 06:20:14.384601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-378faeae-8258-4004-912d-f94d43474f9c req-61209a68-0f78-436b-bd81-06ad32c05b3e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068002 Aug 26 06:20:14.386231 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 245/463] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:20:14.470843 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-43596345-9646-44c3-8b22-55fed4080d9c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:14.477585 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-43596345-9646-44c3-8b22-55fed4080d9c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:14.521540 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43596345-9646-44c3-8b22-55fed4080d9c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:14.525226 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43596345-9646-44c3-8b22-55fed4080d9c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:14.531192 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43596345-9646-44c3-8b22-55fed4080d9c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:14.537018 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43596345-9646-44c3-8b22-55fed4080d9c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:14.540159 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43596345-9646-44c3-8b22-55fed4080d9c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:14.541749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43596345-9646-44c3-8b22-55fed4080d9c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:14.725822 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:14.743827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:14.778964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:14.781175 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-02c0c585-65bf-4cb6-bb4b-a5a04a427a7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.514390 Aug 26 06:20:14.782436 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 219/464] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:14 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:20:14.812148 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-cd59cf66-4a32-4cef-b9d9-5dde5162d14e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:14.812148 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-cd59cf66-4a32-4cef-b9d9-5dde5162d14e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:14.837236 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cd59cf66-4a32-4cef-b9d9-5dde5162d14e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:14.838424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cd59cf66-4a32-4cef-b9d9-5dde5162d14e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:14.839474 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cd59cf66-4a32-4cef-b9d9-5dde5162d14e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:14.840729 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cd59cf66-4a32-4cef-b9d9-5dde5162d14e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:14.841794 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cd59cf66-4a32-4cef-b9d9-5dde5162d14e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:14.842699 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cd59cf66-4a32-4cef-b9d9-5dde5162d14e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:15.142311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-43596345-9646-44c3-8b22-55fed4080d9c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:15.154571 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-43596345-9646-44c3-8b22-55fed4080d9c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.696993 Aug 26 06:20:15.170675 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 246/465] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:14 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:15.170675 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-65d5549c-59e2-47a1-9b05-b8709a570fb7 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:15.170675 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-65d5549c-59e2-47a1-9b05-b8709a570fb7 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:15.184741 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65d5549c-59e2-47a1-9b05-b8709a570fb7 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:15.185984 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65d5549c-59e2-47a1-9b05-b8709a570fb7 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:15.186887 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65d5549c-59e2-47a1-9b05-b8709a570fb7 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:15.188124 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65d5549c-59e2-47a1-9b05-b8709a570fb7 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:15.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65d5549c-59e2-47a1-9b05-b8709a570fb7 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:15.189831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65d5549c-59e2-47a1-9b05-b8709a570fb7 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:15.375090 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-cd59cf66-4a32-4cef-b9d9-5dde5162d14e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:15.383975 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-cd59cf66-4a32-4cef-b9d9-5dde5162d14e tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1504 microversion: 2.1 time: 0.587327 Aug 26 06:20:15.384888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 220/466] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:14 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1504 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:15.405500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a8dae61c-7880-470e-84fa-caf7fb51179e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:15.406347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a8dae61c-7880-470e-84fa-caf7fb51179e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:15.418062 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8dae61c-7880-470e-84fa-caf7fb51179e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:15.419207 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8dae61c-7880-470e-84fa-caf7fb51179e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:15.419821 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8dae61c-7880-470e-84fa-caf7fb51179e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:15.420561 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8dae61c-7880-470e-84fa-caf7fb51179e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:15.421029 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8dae61c-7880-470e-84fa-caf7fb51179e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:15.421987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8dae61c-7880-470e-84fa-caf7fb51179e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:15.586560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-65d5549c-59e2-47a1-9b05-b8709a570fb7 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:15.602594 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-65d5549c-59e2-47a1-9b05-b8709a570fb7 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1303 microversion: 2.1 time: 0.438967 Aug 26 06:20:15.603215 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 247/467] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:15 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1303 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:15.628378 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-c2653487-c5cf-419b-8f5a-4e33592145f9 req-9398fd2c-bf68-4430-af69-acd3f88221fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1745aea6-2b4b-48cb-82d5-3c6f62c9196d", "name": "network-vif-unplugged", "status": "completed", "tag": "56fec6a1-e21d-4fe6-ba05-e70da56fde9b"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:15.655296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-c2653487-c5cf-419b-8f5a-4e33592145f9 req-9398fd2c-bf68-4430-af69-acd3f88221fd service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:15.655296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-c2653487-c5cf-419b-8f5a-4e33592145f9 req-9398fd2c-bf68-4430-af69-acd3f88221fd service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:15.655296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-c2653487-c5cf-419b-8f5a-4e33592145f9 req-9398fd2c-bf68-4430-af69-acd3f88221fd service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:15.674539 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-c2653487-c5cf-419b-8f5a-4e33592145f9 req-9398fd2c-bf68-4430-af69-acd3f88221fd service nova] Creating event network-vif-unplugged:56fec6a1-e21d-4fe6-ba05-e70da56fde9b for instance 1745aea6-2b4b-48cb-82d5-3c6f62c9196d on hv-cinder-85391 Aug 26 06:20:15.683693 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-c2653487-c5cf-419b-8f5a-4e33592145f9 req-9398fd2c-bf68-4430-af69-acd3f88221fd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068089 Aug 26 06:20:15.685305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 248/468] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:20:15.799022 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a8dae61c-7880-470e-84fa-caf7fb51179e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:15.833807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:15.834084 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a8dae61c-7880-470e-84fa-caf7fb51179e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.447262 Aug 26 06:20:15.834234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:15.848367 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 221/469] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:15 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:15.870954 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:15.871732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:15.872365 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:15.873102 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:15.873584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:15.873975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:16.199267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0d81a240-d56d-404c-b659-6f65b8c06030 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:16.200764 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0d81a240-d56d-404c-b659-6f65b8c06030 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:16.242887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0d81a240-d56d-404c-b659-6f65b8c06030 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:16.243401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0d81a240-d56d-404c-b659-6f65b8c06030 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:16.243848 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0d81a240-d56d-404c-b659-6f65b8c06030 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:16.244564 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0d81a240-d56d-404c-b659-6f65b8c06030 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:16.245018 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0d81a240-d56d-404c-b659-6f65b8c06030 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:16.245311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:16.245810 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0d81a240-d56d-404c-b659-6f65b8c06030 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:16.256331 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:16.269214 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:16.269214 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-1dc8b05f-0289-455d-b7af-7356c82ce08f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.434607 Aug 26 06:20:16.269214 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 249/470] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:15 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:16.411949 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-e07f0269-0b1d-4694-903f-bcb89c33e2f3 req-5d873da3-1a22-4aeb-80d3-0bede5a37a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1745aea6-2b4b-48cb-82d5-3c6f62c9196d", "name": "network-vif-deleted", "tag": "56fec6a1-e21d-4fe6-ba05-e70da56fde9b"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:16.433597 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e07f0269-0b1d-4694-903f-bcb89c33e2f3 req-5d873da3-1a22-4aeb-80d3-0bede5a37a50 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:16.434542 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e07f0269-0b1d-4694-903f-bcb89c33e2f3 req-5d873da3-1a22-4aeb-80d3-0bede5a37a50 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:16.435384 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-e07f0269-0b1d-4694-903f-bcb89c33e2f3 req-5d873da3-1a22-4aeb-80d3-0bede5a37a50 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:16.463008 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-e07f0269-0b1d-4694-903f-bcb89c33e2f3 req-5d873da3-1a22-4aeb-80d3-0bede5a37a50 service nova] Creating event network-vif-deleted:56fec6a1-e21d-4fe6-ba05-e70da56fde9b for instance 1745aea6-2b4b-48cb-82d5-3c6f62c9196d on hv-cinder-85391 Aug 26 06:20:16.472543 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-e07f0269-0b1d-4694-903f-bcb89c33e2f3 req-5d873da3-1a22-4aeb-80d3-0bede5a37a50 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068199 Aug 26 06:20:16.478368 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 250/471] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:20:16.484540 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9a59fb72-23f3-41a5-9765-0aa068108b9b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:16.488148 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9a59fb72-23f3-41a5-9765-0aa068108b9b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:16.496876 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9a59fb72-23f3-41a5-9765-0aa068108b9b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:16.497878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9a59fb72-23f3-41a5-9765-0aa068108b9b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:16.498792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9a59fb72-23f3-41a5-9765-0aa068108b9b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:16.500357 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9a59fb72-23f3-41a5-9765-0aa068108b9b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:16.501680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9a59fb72-23f3-41a5-9765-0aa068108b9b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:16.503134 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9a59fb72-23f3-41a5-9765-0aa068108b9b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:16.724097 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9a59fb72-23f3-41a5-9765-0aa068108b9b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:16.725036 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0d81a240-d56d-404c-b659-6f65b8c06030 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:16.725036 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0d81a240-d56d-404c-b659-6f65b8c06030 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.501419 Aug 26 06:20:16.725036 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 222/472] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:16 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:16.725036 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:16.725683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9a59fb72-23f3-41a5-9765-0aa068108b9b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1462 microversion: 2.1 time: 0.216793 Aug 26 06:20:16.725851 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:16.725992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 251/473] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:16 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1462 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:16.726144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:16.726144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:16.726144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:16.726144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:16.726682 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:16.726682 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:16.840411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:16.842141 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:16.843397 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:16.845014 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lazy-loading 'fault' on Instance uuid 40a23686-df31-4e61-879f-e1b1eaaef0ea {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:16.876823 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d67bdae7-5afc-4cb2-adfc-e6673c30824e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:16.878036 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d67bdae7-5afc-4cb2-adfc-e6673c30824e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:16.889946 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d67bdae7-5afc-4cb2-adfc-e6673c30824e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:16.890996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d67bdae7-5afc-4cb2-adfc-e6673c30824e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:16.893348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d67bdae7-5afc-4cb2-adfc-e6673c30824e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:16.893348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d67bdae7-5afc-4cb2-adfc-e6673c30824e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:16.894056 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d67bdae7-5afc-4cb2-adfc-e6673c30824e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:16.895315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d67bdae7-5afc-4cb2-adfc-e6673c30824e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:16.976465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:16.976465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0c5fc729-e5f4-45f4-be5c-631740a23280 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1308 microversion: 2.1 time: 0.275685 Aug 26 06:20:16.976465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 223/474] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:16 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:17.286361 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d67bdae7-5afc-4cb2-adfc-e6673c30824e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:17.292263 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:17.297151 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:17.317205 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d67bdae7-5afc-4cb2-adfc-e6673c30824e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.444675 Aug 26 06:20:17.342822 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 252/475] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:16 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:17.343438 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:17.343438 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:17.343438 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:17.343438 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:17.344075 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:17.351184 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:17.752792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-1f3a8e28-1099-4e87-b808-e4f85a7a5ce6 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:17.753762 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1f3a8e28-1099-4e87-b808-e4f85a7a5ce6 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:17.767651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1f3a8e28-1099-4e87-b808-e4f85a7a5ce6 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:17.774802 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1f3a8e28-1099-4e87-b808-e4f85a7a5ce6 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:17.776659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1f3a8e28-1099-4e87-b808-e4f85a7a5ce6 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:17.779418 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1f3a8e28-1099-4e87-b808-e4f85a7a5ce6 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:17.783840 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1f3a8e28-1099-4e87-b808-e4f85a7a5ce6 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:17.786084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1f3a8e28-1099-4e87-b808-e4f85a7a5ce6 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:17.813505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:17.852179 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:17.855364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:17.857594 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ebb7de6c-296d-47dd-b5da-bc68b034de99 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.575283 Aug 26 06:20:17.868852 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 224/476] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:17 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:17.883688 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f54f8c42-8ce5-4956-a787-46d6c9ae5242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:17.885099 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f54f8c42-8ce5-4956-a787-46d6c9ae5242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:17.898558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f54f8c42-8ce5-4956-a787-46d6c9ae5242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:17.899556 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f54f8c42-8ce5-4956-a787-46d6c9ae5242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:17.900004 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f54f8c42-8ce5-4956-a787-46d6c9ae5242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:17.901731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f54f8c42-8ce5-4956-a787-46d6c9ae5242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:17.902223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f54f8c42-8ce5-4956-a787-46d6c9ae5242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:17.911925 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f54f8c42-8ce5-4956-a787-46d6c9ae5242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:17.997063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1f3a8e28-1099-4e87-b808-e4f85a7a5ce6 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:18.012776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-1f3a8e28-1099-4e87-b808-e4f85a7a5ce6 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1299 microversion: 2.1 time: 0.263354 Aug 26 06:20:18.051109 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 253/477] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:17 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1299 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:18.060066 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:18.061219 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:18.072752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:18.073721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:18.074564 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:18.076146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:18.077025 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:18.077850 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:18.143343 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:18.144431 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:18.145382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:18.146154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lazy-loading 'fault' on Instance uuid 40a23686-df31-4e61-879f-e1b1eaaef0ea {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:18.239511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:18.253729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-91fddccd-3822-4a69-b9f6-91ce4213fb02 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1308 microversion: 2.1 time: 0.200785 Aug 26 06:20:18.257612 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 254/478] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:18 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:18.272082 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f54f8c42-8ce5-4956-a787-46d6c9ae5242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:18.291138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f54f8c42-8ce5-4956-a787-46d6c9ae5242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.420130 Aug 26 06:20:18.292206 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 225/479] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:17 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:18.362653 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-910eaaca-4bb2-42a9-bfcd-8a08c7742767 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:18.369417 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-910eaaca-4bb2-42a9-bfcd-8a08c7742767 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:18.380701 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-910eaaca-4bb2-42a9-bfcd-8a08c7742767 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:18.382106 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-910eaaca-4bb2-42a9-bfcd-8a08c7742767 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:18.383279 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-910eaaca-4bb2-42a9-bfcd-8a08c7742767 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:18.384704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-910eaaca-4bb2-42a9-bfcd-8a08c7742767 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:18.385898 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-910eaaca-4bb2-42a9-bfcd-8a08c7742767 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:18.386745 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-910eaaca-4bb2-42a9-bfcd-8a08c7742767 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:18.664609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-910eaaca-4bb2-42a9-bfcd-8a08c7742767 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:18.680389 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-910eaaca-4bb2-42a9-bfcd-8a08c7742767 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.326653 Aug 26 06:20:18.687653 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 255/480] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:18 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:18.891230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:18.893652 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:18.906045 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:18.907055 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:18.907865 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:18.909878 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:18.909878 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:18.911757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:19.089206 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:19.095923 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:19.102947 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:19.103857 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:19.104750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:19.106474 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:19.107853 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:19.108961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:19.181629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:19.182965 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:19.183953 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:19.184855 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lazy-loading 'fault' on Instance uuid 1745aea6-2b4b-48cb-82d5-3c6f62c9196d {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:19.218142 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:19.232656 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:19.236897 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:19.239630 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3fce7be3-0922-426a-a95c-10ea3f3c5cfc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1744 microversion: 2.20 time: 0.356557 Aug 26 06:20:19.243070 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 226/481] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:18 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1744 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:19.257001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:19.271644 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-18ff9b18-2255-4232-915d-6181add586d8 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1304 microversion: 2.1 time: 0.219696 Aug 26 06:20:19.283181 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 256/482] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:19 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1304 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:19.299047 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:19.305914 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:19.321309 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4ea0410b-67b3-40c1-97dd-43b81e21aed6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:19.323114 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:19.326374 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4ea0410b-67b3-40c1-97dd-43b81e21aed6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:19.327410 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:19.328498 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:19.329587 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:19.330405 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:19.331243 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:19.345473 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ea0410b-67b3-40c1-97dd-43b81e21aed6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:19.351461 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ea0410b-67b3-40c1-97dd-43b81e21aed6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:19.353526 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ea0410b-67b3-40c1-97dd-43b81e21aed6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:19.355770 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ea0410b-67b3-40c1-97dd-43b81e21aed6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:19.356634 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ea0410b-67b3-40c1-97dd-43b81e21aed6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:19.358055 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ea0410b-67b3-40c1-97dd-43b81e21aed6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:19.408787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:19.409442 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:19.410211 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:19.413725 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lazy-loading 'fault' on Instance uuid 40a23686-df31-4e61-879f-e1b1eaaef0ea {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:19.487728 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:19.505087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0db27920-625f-4ef3-8a9a-407f780e1c1f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1308 microversion: 2.1 time: 0.214768 Aug 26 06:20:19.505087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 227/483] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:19 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:19.711072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-08448a27-dcb6-4677-a584-e9c2333e4787 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:19.711687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-08448a27-dcb6-4677-a584-e9c2333e4787 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:19.725244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-08448a27-dcb6-4677-a584-e9c2333e4787 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:19.726104 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-08448a27-dcb6-4677-a584-e9c2333e4787 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:19.727750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-08448a27-dcb6-4677-a584-e9c2333e4787 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:19.728878 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-08448a27-dcb6-4677-a584-e9c2333e4787 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:19.732177 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-08448a27-dcb6-4677-a584-e9c2333e4787 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:19.733021 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-08448a27-dcb6-4677-a584-e9c2333e4787 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:19.760482 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4ea0410b-67b3-40c1-97dd-43b81e21aed6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:19.781300 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4ea0410b-67b3-40c1-97dd-43b81e21aed6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.467689 Aug 26 06:20:19.795656 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 257/484] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:19 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:20.031000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-08448a27-dcb6-4677-a584-e9c2333e4787 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:20.045082 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-08448a27-dcb6-4677-a584-e9c2333e4787 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.338337 Aug 26 06:20:20.071462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 228/485] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:19 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:20.294441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:20.300247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:20.300807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:20.302490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:20.321844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:20.322767 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:20.323452 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:20.324652 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:20.324969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:20.325928 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:20.326309 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:20.326861 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:20.328129 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:20.328727 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:20.329796 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:20.330801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:20.396792 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:20.397477 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:20.398106 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:20.399585 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lazy-loading 'fault' on Instance uuid 1745aea6-2b4b-48cb-82d5-3c6f62c9196d {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:20.511578 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:20.533232 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fe3bcddf-3bc4-4dea-9e77-2d65813dc6e7 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1304 microversion: 2.1 time: 0.241066 Aug 26 06:20:20.546676 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 229/486] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:20 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:20.554805 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:20.554805 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:20.588906 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:20.588906 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:20.588906 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:20.589485 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:20.599951 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:20.600747 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:20.703901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:20.703901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:20.704598 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:20.719890 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lazy-loading 'fault' on Instance uuid 40a23686-df31-4e61-879f-e1b1eaaef0ea {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:20.769438 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:20.789274 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:20.793500 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:20.838981 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9e875ed7-77e5-4d40-b313-33ea0e5aacd6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1744 microversion: 2.20 time: 0.540967 Aug 26 06:20:20.839324 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:20.853152 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 258/487] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:20 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1744 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:20.866087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6f9a42a2-616e-42bd-90a4-006ca653f53e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 200 len: 1308 microversion: 2.1 time: 0.322791 Aug 26 06:20:20.870370 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ab5b3e00-e032-4b3a-afc6-b1848f62c866 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:20.873815 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ab5b3e00-e032-4b3a-afc6-b1848f62c866 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:20.879215 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 230/488] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:20 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 1308 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:20.895322 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ab5b3e00-e032-4b3a-afc6-b1848f62c866 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:20.897051 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ab5b3e00-e032-4b3a-afc6-b1848f62c866 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:20.908357 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ab5b3e00-e032-4b3a-afc6-b1848f62c866 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:20.920721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ab5b3e00-e032-4b3a-afc6-b1848f62c866 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:20.923447 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ab5b3e00-e032-4b3a-afc6-b1848f62c866 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:20.924511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ab5b3e00-e032-4b3a-afc6-b1848f62c866 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:21.080797 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2fe25225-35af-4cec-8db0-dd57512ba2ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:21.082439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2fe25225-35af-4cec-8db0-dd57512ba2ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:21.106096 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2fe25225-35af-4cec-8db0-dd57512ba2ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:21.107530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2fe25225-35af-4cec-8db0-dd57512ba2ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:21.108452 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2fe25225-35af-4cec-8db0-dd57512ba2ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:21.109782 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2fe25225-35af-4cec-8db0-dd57512ba2ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:21.110286 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2fe25225-35af-4cec-8db0-dd57512ba2ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:21.110908 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2fe25225-35af-4cec-8db0-dd57512ba2ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:21.298507 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ab5b3e00-e032-4b3a-afc6-b1848f62c866 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:21.327948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ab5b3e00-e032-4b3a-afc6-b1848f62c866 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.472727 Aug 26 06:20:21.334875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 259/489] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:20 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:21.345627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1866761732", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1551638034", "security_groups": [{"name": "tempest-secgroup-smoke-1659315665"}], "block_device_mapping_v2": [{"uuid": "9b3be7ff-8350-4b44-85ac-7051c56a3321", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c5f68e8-9704-4e4e-a557-4e9515d804ef"}]}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:21.565815 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2fe25225-35af-4cec-8db0-dd57512ba2ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:21.627534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2fe25225-35af-4cec-8db0-dd57512ba2ce tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.544742 Aug 26 06:20:21.633516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 231/490] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:21 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:21.677912 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:21.679557 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:21.708038 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.network.neutron [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] validate_networks() for [('6c5f68e8-9704-4e4e-a557-4e9515d804ef', None, None, None, None, None)] {{(pid=121343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:20:21.710656 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:21.711906 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:21.715437 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:21.719138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:21.724177 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:21.725794 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:21.745764 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:21.861042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:21.861973 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:21.862826 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:21.864499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lazy-loading 'fault' on Instance uuid 1745aea6-2b4b-48cb-82d5-3c6f62c9196d {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:22.012486 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:22.053008 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-71a63d2f-ae38-4c61-8e00-f9cac0935029 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1304 microversion: 2.1 time: 0.416866 Aug 26 06:20:22.053636 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 232/491] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:21 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1304 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:22.070140 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-d364adc1-57fd-4c42-8518-fc58f88eea76 req-afa45ed7-234f-4cfb-adfd-7c8fe365858c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c", "name": "network-vif-plugged", "status": "completed", "tag": "3b7fc810-cb09-42a2-a246-9a1fd1d7d061"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:22.100651 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-d364adc1-57fd-4c42-8518-fc58f88eea76 req-afa45ed7-234f-4cfb-adfd-7c8fe365858c service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:22.100651 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-d364adc1-57fd-4c42-8518-fc58f88eea76 req-afa45ed7-234f-4cfb-adfd-7c8fe365858c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:22.100651 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-d364adc1-57fd-4c42-8518-fc58f88eea76 req-afa45ed7-234f-4cfb-adfd-7c8fe365858c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:22.131417 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-d364adc1-57fd-4c42-8518-fc58f88eea76 req-afa45ed7-234f-4cfb-adfd-7c8fe365858c service nova] Creating event network-vif-plugged:3b7fc810-cb09-42a2-a246-9a1fd1d7d061 for instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c on hv-cinder-85391 Aug 26 06:20:22.146698 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-d364adc1-57fd-4c42-8518-fc58f88eea76 req-afa45ed7-234f-4cfb-adfd-7c8fe365858c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090966 Aug 26 06:20:22.148139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 233/492] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:20:22.158176 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:22.159509 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:22.184353 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:22.185590 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:22.186487 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:22.187919 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:22.188817 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:22.189658 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:22.487103 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:22.501759 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:22.504977 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:22.508684 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-16608240-db7e-4e82-9067-18822e530888 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1744 microversion: 2.20 time: 0.358704 Aug 26 06:20:22.509868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 234/493] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:22 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1744 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:22.515497 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:22.517745 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 40a23686-df31-4e61-879f-e1b1eaaef0ea] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:22.525258 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:22.526097 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:22.526887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:22.527871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:22.528598 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:22.529318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:22.548335 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] HTTP exception thrown: Instance 40a23686-df31-4e61-879f-e1b1eaaef0ea could not be found. Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Request method failure captured: Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea HTTP/1.1 Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGWots-SUETL-YrEQiYZEk4119qZVEGts-PNj41yzjQAOiqUsmDUgri5u0QBxPQsdUbp51DBd2qSU49hQLnqYQokpBhjznlxqRa-RLZU0JsonSWdwnovtrHGrYYTSqqE17S-Mdk7nQM-Kq5Kqsk5G20rOQFH8krnsK8ku3Q5Gg4S9GI Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: 7e90dec3a44a4763b0045af64212fc15 Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-VolumesSnapshotTestJSON-913086289 Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:20:22.550645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7e90dec3a44a4763b0045af64212fc15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7e90dec3a44a4763b0045af64212fc15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7e90dec3a44a4763b0045af64212fc15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7e90dec3a44a4763b0045af64212fc15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-VolumesSnapshotTestJSON-913086289 Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: 7e90dec3a44a4763b0045af64212fc15 Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-913086289 Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-VolumesSnapshotTestJSON-913086289-project Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 543a9cddd92a44c78c26e5b8400e0c98 Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-VolumesSnapshotTestJSON-913086289-project Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance 40a23686-df31-4e61-879f-e1b1eaaef0ea could not be found. Aug 26 06:20:22.552379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '40a23686-df31-4e61-879f-e1b1eaaef0ea'} Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a23686-df31-4e61-879f-e1b1eaaef0ea could not be found. Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:20:22.553198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a23686-df31-4e61-879f-e1b1eaaef0ea could not be found. Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a23686-df31-4e61-879f-e1b1eaaef0ea could not be found. Aug 26 06:20:22.554466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:20:22.556234 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Returning 404 to user: Instance 40a23686-df31-4e61-879f-e1b1eaaef0ea could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:20:22.557665 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ee652d3b-a9a3-4b9b-8665-f8fa4c74e71f tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea" status: 404 len: 111 microversion: 2.1 time: 0.046138 Aug 26 06:20:22.559340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 235/494] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:22 2022] GET /compute/v2.1/servers/40a23686-df31-4e61-879f-e1b1eaaef0ea => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:20:22.578538 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3dee74a8-ab65-4be3-bf75-748bfa872033 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:22.578538 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3dee74a8-ab65-4be3-bf75-748bfa872033 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:22.593568 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dee74a8-ab65-4be3-bf75-748bfa872033 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:22.597907 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dee74a8-ab65-4be3-bf75-748bfa872033 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:22.597907 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dee74a8-ab65-4be3-bf75-748bfa872033 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:22.597907 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dee74a8-ab65-4be3-bf75-748bfa872033 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:22.597907 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dee74a8-ab65-4be3-bf75-748bfa872033 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:22.599021 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dee74a8-ab65-4be3-bf75-748bfa872033 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:22.774395 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Flavor limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:20:22.779385 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Image limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:20:22.780231 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Flavor pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:20:22.780852 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Image pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:20:22.781556 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:20:22.802546 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:22.803462 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:22.804150 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:22.805183 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:22.805955 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:22.806651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:22.852749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Getting quotas for project fde0e661bd5646bab91b5e6b623a2e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:20:22.868455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Getting quotas for user 2f141efe3bb74587b5ba13f0cd5d89db and project fde0e661bd5646bab91b5e6b623a2e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:20:22.933515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3dee74a8-ab65-4be3-bf75-748bfa872033 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:22.968629 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3dee74a8-ab65-4be3-bf75-748bfa872033 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.405484 Aug 26 06:20:22.970139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 236/495] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:22 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:22.975879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f6e70a90-2190-4cee-b278-863224e609bf tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:22.976522 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f6e70a90-2190-4cee-b278-863224e609bf tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:22.993092 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6e70a90-2190-4cee-b278-863224e609bf tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:22.993626 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6e70a90-2190-4cee-b278-863224e609bf tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:22.994081 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6e70a90-2190-4cee-b278-863224e609bf tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:22.994861 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6e70a90-2190-4cee-b278-863224e609bf tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:22.995349 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6e70a90-2190-4cee-b278-863224e609bf tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:22.995768 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6e70a90-2190-4cee-b278-863224e609bf tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:23.023211 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Going to run 1 instances... {{(pid=121343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:20:23.033152 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b3be7ff-8350-4b44-85ac-7051c56a3321',volume_size=None,volume_type=None)] {{(pid=121343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:20:23.271134 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f6e70a90-2190-4cee-b278-863224e609bf tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:23.281121 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f6e70a90-2190-4cee-b278-863224e609bf tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.309194 Aug 26 06:20:23.282333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 237/496] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:22 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:23.291813 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:23.299068 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:23.301974 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:23.302562 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:23.303370 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:23.304411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:23.304901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:23.305409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:23.352846 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:23.353347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:23.353831 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:23.354348 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lazy-loading 'fault' on Instance uuid 1745aea6-2b4b-48cb-82d5-3c6f62c9196d {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:23.431283 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:23.443174 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e4f0382b-3c04-421e-b254-cd5004c43e36 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1304 microversion: 2.1 time: 0.159057 Aug 26 06:20:23.465322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 238/497] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:23 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1304 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:23.559532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:23.561455 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:23.572730 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:23.573235 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:23.573739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:23.585674 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:23.585674 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:23.585674 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:23.856285 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:23.878252 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:23.878252 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:23.879871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-afdeecc9-8df6-46d8-b522-7b62dc9cbcf3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1744 microversion: 2.20 time: 0.334093 Aug 26 06:20:23.886990 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 239/498] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:23 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1744 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:23.997667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-757ad4e7-0a30-415b-882a-c7400f3b00ff tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:23.998184 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-757ad4e7-0a30-415b-882a-c7400f3b00ff tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:24.004757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-757ad4e7-0a30-415b-882a-c7400f3b00ff tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:24.005243 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-757ad4e7-0a30-415b-882a-c7400f3b00ff tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:24.005679 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-757ad4e7-0a30-415b-882a-c7400f3b00ff tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:24.006372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-757ad4e7-0a30-415b-882a-c7400f3b00ff tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:24.006858 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-757ad4e7-0a30-415b-882a-c7400f3b00ff tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:24.007295 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-757ad4e7-0a30-415b-882a-c7400f3b00ff tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:24.154842 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-2bf08d9b-cd9d-4b09-9793-bce68baf4784 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.817980 Aug 26 06:20:24.167450 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 260/499] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:20:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 2832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:20:24.176784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e523542a-0cd8-44c3-83ad-69d19ed7b386 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:24.178386 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e523542a-0cd8-44c3-83ad-69d19ed7b386 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:24.192759 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-757ad4e7-0a30-415b-882a-c7400f3b00ff tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:24.213510 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-757ad4e7-0a30-415b-882a-c7400f3b00ff tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.220796 Aug 26 06:20:24.215754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 240/500] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:23 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:24.264720 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e523542a-0cd8-44c3-83ad-69d19ed7b386 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:24.280419 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e523542a-0cd8-44c3-83ad-69d19ed7b386 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1095 microversion: 2.1 time: 0.105371 Aug 26 06:20:24.280419 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 261/501] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:24 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1095 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:24.308999 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-639bb800-f5df-4c3d-a5aa-d51143671bff tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:24.309696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-639bb800-f5df-4c3d-a5aa-d51143671bff tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:24.316999 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-639bb800-f5df-4c3d-a5aa-d51143671bff tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:24.329397 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-639bb800-f5df-4c3d-a5aa-d51143671bff tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:24.329397 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-639bb800-f5df-4c3d-a5aa-d51143671bff tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:24.329397 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-639bb800-f5df-4c3d-a5aa-d51143671bff tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:24.329397 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-639bb800-f5df-4c3d-a5aa-d51143671bff tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:24.330317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-639bb800-f5df-4c3d-a5aa-d51143671bff tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:24.466650 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:24.467575 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:24.476619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:24.480146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:24.480146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:24.480146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:24.480146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:24.480756 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:24.507839 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-639bb800-f5df-4c3d-a5aa-d51143671bff tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:24.517433 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-639bb800-f5df-4c3d-a5aa-d51143671bff tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.212900 Aug 26 06:20:24.517949 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 241/502] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:24 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:24.541325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:24.542043 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:24.542856 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:24.543636 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lazy-loading 'fault' on Instance uuid 1745aea6-2b4b-48cb-82d5-3c6f62c9196d {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:24.615674 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:24.620511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=100 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:24.627198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-1323488c-583b-46d6-9fd3-1d5d1d8b3dbf tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1304 microversion: 2.1 time: 0.165141 Aug 26 06:20:24.627832 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 262/503] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:24 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1304 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:24.915638 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:24.916672 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:24.924094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:24.924596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:24.925035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:24.925751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:24.926241 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:24.926702 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:25.118723 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:25.130806 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:25.132326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:25.133527 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-65970144-f5e7-403e-bb3f-836b108c426e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1744 microversion: 2.20 time: 0.221945 Aug 26 06:20:25.134095 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 242/504] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:24 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:25.249749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-108c7870-a7df-4739-a14a-c26c915357d5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:25.250540 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-108c7870-a7df-4739-a14a-c26c915357d5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:25.259362 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-108c7870-a7df-4739-a14a-c26c915357d5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:25.261086 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-108c7870-a7df-4739-a14a-c26c915357d5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:25.261086 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-108c7870-a7df-4739-a14a-c26c915357d5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:25.261330 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-108c7870-a7df-4739-a14a-c26c915357d5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:25.261608 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-108c7870-a7df-4739-a14a-c26c915357d5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:25.262047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-108c7870-a7df-4739-a14a-c26c915357d5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:25.298100 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2da85a46-d9e6-4e65-9deb-bd4cc72d591c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:25.299197 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2da85a46-d9e6-4e65-9deb-bd4cc72d591c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:25.374390 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2da85a46-d9e6-4e65-9deb-bd4cc72d591c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:25.383618 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2da85a46-d9e6-4e65-9deb-bd4cc72d591c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1095 microversion: 2.1 time: 0.091396 Aug 26 06:20:25.384358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 243/505] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:25 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:25.443392 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-108c7870-a7df-4739-a14a-c26c915357d5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:25.453230 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-108c7870-a7df-4739-a14a-c26c915357d5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.210052 Aug 26 06:20:25.454210 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 263/506] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:25 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:25.546950 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4ecbdba0-fb81-4204-9480-c75fc1d83066 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:25.548105 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4ecbdba0-fb81-4204-9480-c75fc1d83066 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:25.557909 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ecbdba0-fb81-4204-9480-c75fc1d83066 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:25.558652 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ecbdba0-fb81-4204-9480-c75fc1d83066 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:25.559196 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ecbdba0-fb81-4204-9480-c75fc1d83066 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:25.560070 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ecbdba0-fb81-4204-9480-c75fc1d83066 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:25.560673 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ecbdba0-fb81-4204-9480-c75fc1d83066 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:25.561248 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ecbdba0-fb81-4204-9480-c75fc1d83066 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:25.664773 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:25.665842 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:25.676647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:25.677506 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:25.678285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:25.679191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:25.679698 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:25.680170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:25.737841 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:25.738476 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:25.739129 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:25.739581 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lazy-loading 'fault' on Instance uuid 1745aea6-2b4b-48cb-82d5-3c6f62c9196d {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:25.750109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4ecbdba0-fb81-4204-9480-c75fc1d83066 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:25.763487 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4ecbdba0-fb81-4204-9480-c75fc1d83066 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.223152 Aug 26 06:20:25.764499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 244/507] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:25 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:25.807836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:25.816184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bcc6f64b-0030-41b1-a7f0-daaf38b3540d tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1304 microversion: 2.1 time: 0.159746 Aug 26 06:20:25.817595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 264/508] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:25 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1304 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:26.172376 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:26.173249 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:26.181121 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:26.181769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:26.182304 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:26.183134 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:26.183899 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:26.184369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:26.341257 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:26.352345 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:26.353785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:26.355391 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2510c03d-9281-40b0-927e-78a592ee69c1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1744 microversion: 2.20 time: 0.187272 Aug 26 06:20:26.356050 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 245/509] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:26 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:26.416666 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9251419e-85ea-4610-a895-7977ef1e72e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:26.419773 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9251419e-85ea-4610-a895-7977ef1e72e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:26.437113 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9251419e-85ea-4610-a895-7977ef1e72e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:26.438406 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9251419e-85ea-4610-a895-7977ef1e72e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:26.439491 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9251419e-85ea-4610-a895-7977ef1e72e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:26.440532 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9251419e-85ea-4610-a895-7977ef1e72e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:26.441235 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9251419e-85ea-4610-a895-7977ef1e72e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:26.442550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9251419e-85ea-4610-a895-7977ef1e72e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:26.480413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4c0729fb-9837-42f9-a69b-5b40c563be92 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:26.481441 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4c0729fb-9837-42f9-a69b-5b40c563be92 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:26.491149 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c0729fb-9837-42f9-a69b-5b40c563be92 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:26.491987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c0729fb-9837-42f9-a69b-5b40c563be92 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:26.492683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c0729fb-9837-42f9-a69b-5b40c563be92 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:26.493876 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c0729fb-9837-42f9-a69b-5b40c563be92 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:26.494642 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c0729fb-9837-42f9-a69b-5b40c563be92 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:26.495402 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4c0729fb-9837-42f9-a69b-5b40c563be92 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:26.518680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9251419e-85ea-4610-a895-7977ef1e72e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:26.532889 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9251419e-85ea-4610-a895-7977ef1e72e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1145 microversion: 2.1 time: 0.126448 Aug 26 06:20:26.533886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 265/510] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:26 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1145 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:26.694802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4c0729fb-9837-42f9-a69b-5b40c563be92 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:26.707817 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4c0729fb-9837-42f9-a69b-5b40c563be92 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.233938 Aug 26 06:20:26.711299 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 246/511] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:26 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:26.788477 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6e4b463d-f79c-4e76-a04b-d38eb7690b89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:26.789468 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6e4b463d-f79c-4e76-a04b-d38eb7690b89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:26.796790 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6e4b463d-f79c-4e76-a04b-d38eb7690b89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:26.797255 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6e4b463d-f79c-4e76-a04b-d38eb7690b89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:26.797688 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6e4b463d-f79c-4e76-a04b-d38eb7690b89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:26.798375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6e4b463d-f79c-4e76-a04b-d38eb7690b89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:26.798869 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6e4b463d-f79c-4e76-a04b-d38eb7690b89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:26.799287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6e4b463d-f79c-4e76-a04b-d38eb7690b89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:26.841782 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:26.843093 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:26.854025 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:26.855045 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:26.855665 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:26.856401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:26.857188 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:26.857940 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:26.897278 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:26.897801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:26.898245 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:26.898736 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lazy-loading 'fault' on Instance uuid 1745aea6-2b4b-48cb-82d5-3c6f62c9196d {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:26.971195 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:26.982988 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7311cb08-cbeb-46e1-8f3b-7e90f7cb5c5a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1304 microversion: 2.1 time: 0.147530 Aug 26 06:20:26.983995 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 247/512] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:26 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:26.989810 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6e4b463d-f79c-4e76-a04b-d38eb7690b89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:27.003966 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6e4b463d-f79c-4e76-a04b-d38eb7690b89 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.219940 Aug 26 06:20:27.004782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 266/513] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:26 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:27.382924 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:27.383543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:27.390389 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:27.390904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:27.391329 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:27.393498 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:27.393498 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:27.393498 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:27.568692 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:27.571144 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-83170107-081c-420d-bcbc-8c72b6f265e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:27.572452 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-83170107-081c-420d-bcbc-8c72b6f265e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:27.583078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:27.583852 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-83170107-081c-420d-bcbc-8c72b6f265e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:27.584673 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-83170107-081c-420d-bcbc-8c72b6f265e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:27.585187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:27.585430 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-83170107-081c-420d-bcbc-8c72b6f265e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:27.586665 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-83170107-081c-420d-bcbc-8c72b6f265e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:27.587041 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0adaaf77-89d6-4098-a968-952146325639 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1744 microversion: 2.20 time: 0.210454 Aug 26 06:20:27.587507 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-83170107-081c-420d-bcbc-8c72b6f265e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:27.587803 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 248/514] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:27 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:27.588260 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-83170107-081c-420d-bcbc-8c72b6f265e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:27.688294 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-83170107-081c-420d-bcbc-8c72b6f265e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:27.696908 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-83170107-081c-420d-bcbc-8c72b6f265e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1145 microversion: 2.1 time: 0.132773 Aug 26 06:20:27.697515 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 267/515] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:27 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1145 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:27.732681 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-bdb69dde-fb5c-48f6-80ab-05e074b051ec tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:27.733289 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-bdb69dde-fb5c-48f6-80ab-05e074b051ec tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:27.735329 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:27.742220 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bdb69dde-fb5c-48f6-80ab-05e074b051ec tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:27.742779 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bdb69dde-fb5c-48f6-80ab-05e074b051ec tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:27.743295 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bdb69dde-fb5c-48f6-80ab-05e074b051ec tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:27.744105 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bdb69dde-fb5c-48f6-80ab-05e074b051ec tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:27.744656 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bdb69dde-fb5c-48f6-80ab-05e074b051ec tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:27.745136 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bdb69dde-fb5c-48f6-80ab-05e074b051ec tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:27.902156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-bdb69dde-fb5c-48f6-80ab-05e074b051ec tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:27.905779 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:27.911138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-bdb69dde-fb5c-48f6-80ab-05e074b051ec tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.181786 Aug 26 06:20:27.916200 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 249/516] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:27 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:28.008928 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:28.009611 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:28.016334 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:28.016822 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:28.017348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:28.018067 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:28.018528 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:28.018982 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:28.034070 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a51faf3f-ced7-49ae-91bc-33211f390994 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:28.035411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a51faf3f-ced7-49ae-91bc-33211f390994 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:28.049239 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51faf3f-ced7-49ae-91bc-33211f390994 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:28.049745 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51faf3f-ced7-49ae-91bc-33211f390994 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:28.050292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51faf3f-ced7-49ae-91bc-33211f390994 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:28.051580 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51faf3f-ced7-49ae-91bc-33211f390994 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:28.052312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51faf3f-ced7-49ae-91bc-33211f390994 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:28.052981 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a51faf3f-ced7-49ae-91bc-33211f390994 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:28.061657 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:28.062445 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:28.063416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:28.064349 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lazy-loading 'fault' on Instance uuid 1745aea6-2b4b-48cb-82d5-3c6f62c9196d {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:28.123332 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:28.138036 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-2721cb0c-35df-4915-ac13-9da93b9523ac tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 200 len: 1304 microversion: 2.1 time: 0.134805 Aug 26 06:20:28.139361 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 268/517] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:28 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:28.270859 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a51faf3f-ced7-49ae-91bc-33211f390994 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:28.280344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a51faf3f-ced7-49ae-91bc-33211f390994 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.255920 Aug 26 06:20:28.280936 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 250/518] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:28 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:28.617323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:28.618467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:28.625612 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:28.626415 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:28.626953 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:28.627838 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:28.628547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:28.629976 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:28.725639 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fdfa1617-9508-4e73-b8db-355c4eceef77 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:28.727143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fdfa1617-9508-4e73-b8db-355c4eceef77 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:28.734919 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdfa1617-9508-4e73-b8db-355c4eceef77 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:28.735420 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdfa1617-9508-4e73-b8db-355c4eceef77 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:28.736027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdfa1617-9508-4e73-b8db-355c4eceef77 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:28.736975 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdfa1617-9508-4e73-b8db-355c4eceef77 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:28.737465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdfa1617-9508-4e73-b8db-355c4eceef77 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:28.738104 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdfa1617-9508-4e73-b8db-355c4eceef77 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:28.805029 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:28.813865 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:28.814833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fdfa1617-9508-4e73-b8db-355c4eceef77 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:28.815562 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:28.817850 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-25fe21c5-631a-4c24-b978-5566bae11971 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1744 microversion: 2.20 time: 0.208628 Aug 26 06:20:28.818991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 269/519] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:28 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1744 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:28.830502 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fdfa1617-9508-4e73-b8db-355c4eceef77 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1145 microversion: 2.1 time: 0.111326 Aug 26 06:20:28.845452 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 251/520] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:28 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1145 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:28.937237 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-eaab1eb5-2aee-41cf-bcc2-e4eab28c4d13 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:28.938311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-eaab1eb5-2aee-41cf-bcc2-e4eab28c4d13 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:28.948031 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaab1eb5-2aee-41cf-bcc2-e4eab28c4d13 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:28.948783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaab1eb5-2aee-41cf-bcc2-e4eab28c4d13 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:28.949222 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaab1eb5-2aee-41cf-bcc2-e4eab28c4d13 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:28.949932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaab1eb5-2aee-41cf-bcc2-e4eab28c4d13 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:28.950386 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaab1eb5-2aee-41cf-bcc2-e4eab28c4d13 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:28.950857 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-eaab1eb5-2aee-41cf-bcc2-e4eab28c4d13 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:29.133664 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-eaab1eb5-2aee-41cf-bcc2-e4eab28c4d13 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:29.143039 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-eaab1eb5-2aee-41cf-bcc2-e4eab28c4d13 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.212787 Aug 26 06:20:29.143783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 270/521] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:28 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:29.175069 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:29.176734 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: 1745aea6-2b4b-48cb-82d5-3c6f62c9196d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:29.204409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:29.204409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:29.204409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:29.204409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:29.205310 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:29.205310 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:29.205310 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] HTTP exception thrown: Instance 1745aea6-2b4b-48cb-82d5-3c6f62c9196d could not be found. Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Request method failure captured: Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d HTTP/1.1 Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGXq2h_4ODG1VcpteGWQxhJ8Pqxs_4jLWCxG13ytQUqbDjKl1cswn-He69NIxvTAxqabNP5FXwZe4XJs0NbecCZajdeKaZDhu-wPwExWtxo7fXslOmFrwpcSCh3oTrGxmfg37K3kScSUOBUam57BLydcjb00HAlvU54d1sKUPkhU9T8 Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: b38f9319c7534904ac58d1d9f9048b91 Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-VolumesActionsTest-1836030690 Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:20:29.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b38f9319c7534904ac58d1d9f9048b91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b38f9319c7534904ac58d1d9f9048b91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b38f9319c7534904ac58d1d9f9048b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b38f9319c7534904ac58d1d9f9048b91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-VolumesActionsTest-1836030690 Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: b38f9319c7534904ac58d1d9f9048b91 Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-VolumesActionsTest-1836030690 Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-VolumesActionsTest-1836030690-project Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 2cffd4ac2817448e94d2b32ac7ffcede Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-VolumesActionsTest-1836030690-project Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance 1745aea6-2b4b-48cb-82d5-3c6f62c9196d could not be found. Aug 26 06:20:29.214108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '1745aea6-2b4b-48cb-82d5-3c6f62c9196d'} Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1745aea6-2b4b-48cb-82d5-3c6f62c9196d could not be found. Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:20:29.215928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1745aea6-2b4b-48cb-82d5-3c6f62c9196d could not be found. Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1745aea6-2b4b-48cb-82d5-3c6f62c9196d could not be found. Aug 26 06:20:29.217991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:20:29.220527 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Returning 404 to user: Instance 1745aea6-2b4b-48cb-82d5-3c6f62c9196d could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:20:29.220527 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d7c2a0f4-21ad-4394-a86c-9e3c902c348b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d" status: 404 len: 111 microversion: 2.1 time: 0.047391 Aug 26 06:20:29.220527 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 252/522] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:29 2022] GET /compute/v2.1/servers/1745aea6-2b4b-48cb-82d5-3c6f62c9196d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:20:29.302773 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-37d43335-8bdc-45bb-a480-05df93a7d9f3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:29.303490 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-37d43335-8bdc-45bb-a480-05df93a7d9f3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:29.312115 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-37d43335-8bdc-45bb-a480-05df93a7d9f3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:29.312596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-37d43335-8bdc-45bb-a480-05df93a7d9f3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:29.313258 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-37d43335-8bdc-45bb-a480-05df93a7d9f3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:29.313961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-37d43335-8bdc-45bb-a480-05df93a7d9f3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:29.314422 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-37d43335-8bdc-45bb-a480-05df93a7d9f3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:29.314893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-37d43335-8bdc-45bb-a480-05df93a7d9f3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:29.401927 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-243032753", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "networks": [{"uuid": "acb716de-6bc0-4261-b952-78c0c00f2891"}]}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:29.520596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] validate_networks() for [('acb716de-6bc0-4261-b952-78c0c00f2891', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:20:29.529566 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-37d43335-8bdc-45bb-a480-05df93a7d9f3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:29.549371 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-37d43335-8bdc-45bb-a480-05df93a7d9f3 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.250623 Aug 26 06:20:29.550476 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 271/523] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:29 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:29.849975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:29.851468 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:29.867902 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:29.867902 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:29.867902 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:29.868884 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:29.869737 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:29.870719 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:30.295096 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:30.310839 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:30.317837 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:30.319879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-edda0006-4738-4ca5-9d25-2b3c0e6480aa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.477393 Aug 26 06:20:30.320816 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 272/524] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:29 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:30.341109 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7d8481cc-1873-4106-b8d4-fddb274ef58e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:30.342197 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7d8481cc-1873-4106-b8d4-fddb274ef58e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:30.362975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d8481cc-1873-4106-b8d4-fddb274ef58e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:30.364205 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d8481cc-1873-4106-b8d4-fddb274ef58e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:30.395456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d8481cc-1873-4106-b8d4-fddb274ef58e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:30.395456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d8481cc-1873-4106-b8d4-fddb274ef58e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:30.395456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d8481cc-1873-4106-b8d4-fddb274ef58e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:30.395456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d8481cc-1873-4106-b8d4-fddb274ef58e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:30.541662 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7d8481cc-1873-4106-b8d4-fddb274ef58e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:30.578894 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7d8481cc-1873-4106-b8d4-fddb274ef58e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1193 microversion: 2.1 time: 0.256490 Aug 26 06:20:30.580163 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 273/525] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:30 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1193 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:30.605366 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bb3de0a2-1c9b-4ee3-887b-797b5d70f086 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:30.605992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-bb3de0a2-1c9b-4ee3-887b-797b5d70f086 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:30.626510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb3de0a2-1c9b-4ee3-887b-797b5d70f086 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:30.627095 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb3de0a2-1c9b-4ee3-887b-797b5d70f086 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:30.628527 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb3de0a2-1c9b-4ee3-887b-797b5d70f086 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:30.628527 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb3de0a2-1c9b-4ee3-887b-797b5d70f086 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:30.628914 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb3de0a2-1c9b-4ee3-887b-797b5d70f086 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:30.629240 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb3de0a2-1c9b-4ee3-887b-797b5d70f086 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:30.686361 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:20:30.687024 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:20:30.687717 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:20:30.688142 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:20:30.688562 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:20:30.702699 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:30.706259 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:30.707858 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:30.709879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:30.710598 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:30.711399 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:30.750575 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Getting quotas for project b38f9319c7534904ac58d1d9f9048b91. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:20:30.759832 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Getting quotas for user 2cffd4ac2817448e94d2b32ac7ffcede and project b38f9319c7534904ac58d1d9f9048b91. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:20:30.789318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:20:30.794231 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:20:30.928750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bb3de0a2-1c9b-4ee3-887b-797b5d70f086 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:30.939399 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bb3de0a2-1c9b-4ee3-887b-797b5d70f086 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.343637 Aug 26 06:20:30.940775 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 274/526] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:30 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:30.946951 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-190fabbf-f9a1-4ec5-a68e-4142b725fb8d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:30.947993 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-190fabbf-f9a1-4ec5-a68e-4142b725fb8d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:30.956800 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190fabbf-f9a1-4ec5-a68e-4142b725fb8d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:30.958325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190fabbf-f9a1-4ec5-a68e-4142b725fb8d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:30.960737 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190fabbf-f9a1-4ec5-a68e-4142b725fb8d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:30.963002 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190fabbf-f9a1-4ec5-a68e-4142b725fb8d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:30.963894 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190fabbf-f9a1-4ec5-a68e-4142b725fb8d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:30.964828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190fabbf-f9a1-4ec5-a68e-4142b725fb8d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:31.163740 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-190fabbf-f9a1-4ec5-a68e-4142b725fb8d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:31.179379 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-190fabbf-f9a1-4ec5-a68e-4142b725fb8d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1676 microversion: 2.1 time: 0.236233 Aug 26 06:20:31.180418 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 275/527] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:30 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:31.189160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6eb8338c-77b0-4d83-8147-61d28cac5365 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ea527f3-b73c-471a-8c87-dce4881165cd"}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:31.194496 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6eb8338c-77b0-4d83-8147-61d28cac5365 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:31.211035 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6eb8338c-77b0-4d83-8147-61d28cac5365 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:31.211526 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6eb8338c-77b0-4d83-8147-61d28cac5365 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:31.211975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6eb8338c-77b0-4d83-8147-61d28cac5365 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:31.213061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6eb8338c-77b0-4d83-8147-61d28cac5365 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:31.213849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6eb8338c-77b0-4d83-8147-61d28cac5365 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:31.214386 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6eb8338c-77b0-4d83-8147-61d28cac5365 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:32.240800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7c340fa2-49ce-4c12-95e4-41896f54510c tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.841531 Aug 26 06:20:32.255518 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 253/528] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 06:20:32.280059 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:32.281178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:32.291691 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:32.292693 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:32.293538 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:32.295778 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:32.303054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:32.303743 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:32.601222 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:32.640288 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:32.649574 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:32.655386 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8b55ae45-5c35-4c72-92bd-3dabdcc90266 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.392232 Aug 26 06:20:32.659298 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 254/529] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:32 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:32.694077 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9e62e3af-be5a-4e76-893c-c786c644ded0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:32.695030 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9e62e3af-be5a-4e76-893c-c786c644ded0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:32.702313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e62e3af-be5a-4e76-893c-c786c644ded0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:32.709245 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e62e3af-be5a-4e76-893c-c786c644ded0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:32.710098 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e62e3af-be5a-4e76-893c-c786c644ded0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:32.711340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e62e3af-be5a-4e76-893c-c786c644ded0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:32.711955 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e62e3af-be5a-4e76-893c-c786c644ded0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:32.712407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e62e3af-be5a-4e76-893c-c786c644ded0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:32.831283 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:32.848411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9e62e3af-be5a-4e76-893c-c786c644ded0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:32.857893 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9e62e3af-be5a-4e76-893c-c786c644ded0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1201 microversion: 2.1 time: 0.195174 Aug 26 06:20:32.859301 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 255/530] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:32 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1201 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:32.867780 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-18aebb6e-4ece-4d05-a89b-2e6cfb468167 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:32.868394 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-18aebb6e-4ece-4d05-a89b-2e6cfb468167 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:32.881987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18aebb6e-4ece-4d05-a89b-2e6cfb468167 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:32.882489 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18aebb6e-4ece-4d05-a89b-2e6cfb468167 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:32.883182 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18aebb6e-4ece-4d05-a89b-2e6cfb468167 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:32.883915 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18aebb6e-4ece-4d05-a89b-2e6cfb468167 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:32.884374 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18aebb6e-4ece-4d05-a89b-2e6cfb468167 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:32.884938 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-18aebb6e-4ece-4d05-a89b-2e6cfb468167 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:33.187925 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-18aebb6e-4ece-4d05-a89b-2e6cfb468167 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:33.190070 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-18aebb6e-4ece-4d05-a89b-2e6cfb468167 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.328699 Aug 26 06:20:33.192051 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 256/531] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:32 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:33.211302 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0669cae9-4798-4c20-8bdf-b8817c64f58c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:33.211943 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0669cae9-4798-4c20-8bdf-b8817c64f58c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:33.218426 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0669cae9-4798-4c20-8bdf-b8817c64f58c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:33.219199 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0669cae9-4798-4c20-8bdf-b8817c64f58c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:33.220087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0669cae9-4798-4c20-8bdf-b8817c64f58c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:33.221128 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0669cae9-4798-4c20-8bdf-b8817c64f58c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:33.222030 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0669cae9-4798-4c20-8bdf-b8817c64f58c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:33.223373 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0669cae9-4798-4c20-8bdf-b8817c64f58c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:33.666465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0669cae9-4798-4c20-8bdf-b8817c64f58c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:33.679271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0669cae9-4798-4c20-8bdf-b8817c64f58c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1653 microversion: 2.1 time: 0.473138 Aug 26 06:20:33.680062 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 257/532] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:33 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1653 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:33.712693 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a5d61672-b50a-4ecd-8594-ea0fca8b9b24 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:33.713443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a5d61672-b50a-4ecd-8594-ea0fca8b9b24 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:33.803359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a5d61672-b50a-4ecd-8594-ea0fca8b9b24 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:33.818432 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a5d61672-b50a-4ecd-8594-ea0fca8b9b24 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1213 microversion: 2.1 time: 0.123407 Aug 26 06:20:33.820825 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 258/533] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:33 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:33.826185 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:33.827661 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:33.835160 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:33.835844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:33.836444 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:33.837231 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:33.838029 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:33.838417 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:33.840161 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6eb8338c-77b0-4d83-8147-61d28cac5365 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "POST /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.658020 Aug 26 06:20:33.841813 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 276/534] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:20:31 2022] POST /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments => generated 194 bytes in 2661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:20:33.847344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-89eb8c2f-5653-4358-a6ce-ab3017c1c183 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:33.855587 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89eb8c2f-5653-4358-a6ce-ab3017c1c183 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:33.856326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89eb8c2f-5653-4358-a6ce-ab3017c1c183 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:33.857567 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89eb8c2f-5653-4358-a6ce-ab3017c1c183 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:33.873088 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:33.888198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-89eb8c2f-5653-4358-a6ce-ab3017c1c183 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Going to try to start instance {{(pid=121343) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 06:20:34.100171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:34.117002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:34.121486 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:34.123984 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7683561e-783a-427d-bd29-dd15806f3737 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.301395 Aug 26 06:20:34.125223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 259/535] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:33 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:34.150217 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-907a4b0b-2d9b-4614-b9d3-c69516e58ee5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:34.150881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-907a4b0b-2d9b-4614-b9d3-c69516e58ee5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:34.158507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-907a4b0b-2d9b-4614-b9d3-c69516e58ee5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:34.159393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-907a4b0b-2d9b-4614-b9d3-c69516e58ee5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:34.159969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-907a4b0b-2d9b-4614-b9d3-c69516e58ee5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:34.160790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-907a4b0b-2d9b-4614-b9d3-c69516e58ee5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:34.161257 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-907a4b0b-2d9b-4614-b9d3-c69516e58ee5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:34.161688 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-907a4b0b-2d9b-4614-b9d3-c69516e58ee5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:34.270907 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=8 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:34.361317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-89eb8c2f-5653-4358-a6ce-ab3017c1c183 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "POST /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/action" status: 202 len: 0 microversion: 2.1 time: 0.517721 Aug 26 06:20:34.361956 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 277/536] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:20:33 2022] POST /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:20:34.384297 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d0508270-07f2-448f-8072-c46d9799f36c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:34.402858 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d0508270-07f2-448f-8072-c46d9799f36c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:34.402858 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:34.402858 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d0508270-07f2-448f-8072-c46d9799f36c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:34.402858 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d0508270-07f2-448f-8072-c46d9799f36c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:34.404120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d0508270-07f2-448f-8072-c46d9799f36c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:34.404120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d0508270-07f2-448f-8072-c46d9799f36c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:34.404120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d0508270-07f2-448f-8072-c46d9799f36c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:34.404120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d0508270-07f2-448f-8072-c46d9799f36c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:34.513899 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-907a4b0b-2d9b-4614-b9d3-c69516e58ee5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:34.532169 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-907a4b0b-2d9b-4614-b9d3-c69516e58ee5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1279 microversion: 2.1 time: 0.393880 Aug 26 06:20:34.533591 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 260/537] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:34 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1279 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:34.542181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-cba68ce5-862f-45f9-a99f-8ce2ffcc0888 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:34.543062 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-cba68ce5-862f-45f9-a99f-8ce2ffcc0888 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:34.556398 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cba68ce5-862f-45f9-a99f-8ce2ffcc0888 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:34.556398 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cba68ce5-862f-45f9-a99f-8ce2ffcc0888 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:34.558460 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cba68ce5-862f-45f9-a99f-8ce2ffcc0888 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:34.559263 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cba68ce5-862f-45f9-a99f-8ce2ffcc0888 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:34.560031 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cba68ce5-862f-45f9-a99f-8ce2ffcc0888 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:34.560031 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cba68ce5-862f-45f9-a99f-8ce2ffcc0888 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:34.767731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-cba68ce5-862f-45f9-a99f-8ce2ffcc0888 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:34.779628 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-cba68ce5-862f-45f9-a99f-8ce2ffcc0888 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1662 microversion: 2.1 time: 0.243379 Aug 26 06:20:34.794650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 261/538] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:34 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1662 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:34.849521 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8a354352-87b9-40bf-8152-15297fc22179 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:34.850345 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8a354352-87b9-40bf-8152-15297fc22179 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:34.857117 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a354352-87b9-40bf-8152-15297fc22179 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:34.857607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a354352-87b9-40bf-8152-15297fc22179 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:34.858063 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a354352-87b9-40bf-8152-15297fc22179 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:34.858806 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a354352-87b9-40bf-8152-15297fc22179 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:34.859251 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a354352-87b9-40bf-8152-15297fc22179 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:34.859671 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8a354352-87b9-40bf-8152-15297fc22179 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:34.909354 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d0508270-07f2-448f-8072-c46d9799f36c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:34.919060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d0508270-07f2-448f-8072-c46d9799f36c tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.553449 Aug 26 06:20:34.920066 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 278/539] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:34 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:34.938385 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8a354352-87b9-40bf-8152-15297fc22179 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:34.941901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8a354352-87b9-40bf-8152-15297fc22179 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1217 microversion: 2.1 time: 0.100074 Aug 26 06:20:34.942952 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 262/540] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:34 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:35.158093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:35.159180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:35.166954 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:35.167458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:35.167906 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:35.168652 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:35.169411 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:35.169926 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:35.369461 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:35.383904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:35.386440 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:35.388771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-40a33034-ebe9-484d-a34a-68dc80cdae43 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.236455 Aug 26 06:20:35.390200 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 279/541] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:35 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:35.561754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b0190664-031d-492b-8e18-f770ccb68f34 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:35.562916 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b0190664-031d-492b-8e18-f770ccb68f34 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:35.572308 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b0190664-031d-492b-8e18-f770ccb68f34 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:35.574944 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b0190664-031d-492b-8e18-f770ccb68f34 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:35.576395 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b0190664-031d-492b-8e18-f770ccb68f34 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:35.577997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b0190664-031d-492b-8e18-f770ccb68f34 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:35.579221 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b0190664-031d-492b-8e18-f770ccb68f34 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:35.580335 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b0190664-031d-492b-8e18-f770ccb68f34 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:35.767549 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b0190664-031d-492b-8e18-f770ccb68f34 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:35.777649 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b0190664-031d-492b-8e18-f770ccb68f34 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1279 microversion: 2.1 time: 0.223300 Aug 26 06:20:35.779284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 263/542] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:35 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1279 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:35.813274 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4ab2e26d-ce58-4cfe-a5ac-dfe6facb85f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:35.815916 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4ab2e26d-ce58-4cfe-a5ac-dfe6facb85f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:35.821168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ab2e26d-ce58-4cfe-a5ac-dfe6facb85f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:35.826049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ab2e26d-ce58-4cfe-a5ac-dfe6facb85f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:35.826049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ab2e26d-ce58-4cfe-a5ac-dfe6facb85f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:35.826049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ab2e26d-ce58-4cfe-a5ac-dfe6facb85f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:35.826049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ab2e26d-ce58-4cfe-a5ac-dfe6facb85f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:35.826430 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ab2e26d-ce58-4cfe-a5ac-dfe6facb85f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:35.952315 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4a2db23f-1d0b-4579-a676-69892feda549 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:35.969356 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4a2db23f-1d0b-4579-a676-69892feda549 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:36.015062 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a2db23f-1d0b-4579-a676-69892feda549 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:36.016043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a2db23f-1d0b-4579-a676-69892feda549 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:36.020656 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a2db23f-1d0b-4579-a676-69892feda549 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:36.022272 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a2db23f-1d0b-4579-a676-69892feda549 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:36.028374 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a2db23f-1d0b-4579-a676-69892feda549 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:36.029238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4a2db23f-1d0b-4579-a676-69892feda549 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:36.123071 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4ab2e26d-ce58-4cfe-a5ac-dfe6facb85f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:36.157352 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4ab2e26d-ce58-4cfe-a5ac-dfe6facb85f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1662 microversion: 2.1 time: 0.347775 Aug 26 06:20:36.157945 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 280/543] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:35 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1662 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:36.210165 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-725b2a7f-d7d3-4795-958f-5c3c5c2d5f32 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:36.215086 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-725b2a7f-d7d3-4795-958f-5c3c5c2d5f32 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:36.248376 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-725b2a7f-d7d3-4795-958f-5c3c5c2d5f32 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:36.252287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-725b2a7f-d7d3-4795-958f-5c3c5c2d5f32 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:36.252287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-725b2a7f-d7d3-4795-958f-5c3c5c2d5f32 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:36.252817 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-725b2a7f-d7d3-4795-958f-5c3c5c2d5f32 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:36.253746 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-725b2a7f-d7d3-4795-958f-5c3c5c2d5f32 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:36.255468 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-725b2a7f-d7d3-4795-958f-5c3c5c2d5f32 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:36.406406 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-725b2a7f-d7d3-4795-958f-5c3c5c2d5f32 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:36.444872 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-725b2a7f-d7d3-4795-958f-5c3c5c2d5f32 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1217 microversion: 2.1 time: 0.285784 Aug 26 06:20:36.451067 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 281/544] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:36 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1217 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:36.460480 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:36.468579 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:36.494104 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:36.495101 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:36.495643 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4a2db23f-1d0b-4579-a676-69892feda549 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:36.495797 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:36.496662 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:36.498145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:36.498481 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:36.518644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4a2db23f-1d0b-4579-a676-69892feda549 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.574015 Aug 26 06:20:36.523900 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 264/545] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:35 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:36.693321 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-486676022", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "networks": [{"uuid": "be8035ab-d66f-4876-a168-341d4ebde9a9"}]}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:36.834922 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] validate_networks() for [('be8035ab-d66f-4876-a168-341d4ebde9a9', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:20:36.848352 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:36.884636 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:36.886722 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:36.888237 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-991694f4-0b70-4ca9-9a80-3311df2f8cbd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.436076 Aug 26 06:20:36.889010 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 282/546] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:36 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:36.894538 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c05def36-e26f-4f11-970b-9038ec4940c7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:36.903699 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c05def36-e26f-4f11-970b-9038ec4940c7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:36.920588 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c05def36-e26f-4f11-970b-9038ec4940c7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:36.921115 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c05def36-e26f-4f11-970b-9038ec4940c7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:36.921558 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c05def36-e26f-4f11-970b-9038ec4940c7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:36.922544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c05def36-e26f-4f11-970b-9038ec4940c7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:36.923214 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c05def36-e26f-4f11-970b-9038ec4940c7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:36.923843 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c05def36-e26f-4f11-970b-9038ec4940c7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:37.537790 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c05def36-e26f-4f11-970b-9038ec4940c7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:37.580580 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c05def36-e26f-4f11-970b-9038ec4940c7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1279 microversion: 2.1 time: 0.689797 Aug 26 06:20:37.597118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 283/547] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:36 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1279 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:37.609490 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-211b030d-e9aa-4f37-9ffc-3c200cc76f69 req-2dfb36ed-e590-4a11-90b2-df52c191dd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff368667-d93b-4b10-9606-09331ebb857c", "name": "network-vif-plugged", "status": "completed", "tag": "f4d37966-d902-4c07-9ee5-4be2e42d1714"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:37.655505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-211b030d-e9aa-4f37-9ffc-3c200cc76f69 req-2dfb36ed-e590-4a11-90b2-df52c191dd2d service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:37.656731 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-211b030d-e9aa-4f37-9ffc-3c200cc76f69 req-2dfb36ed-e590-4a11-90b2-df52c191dd2d service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:37.657399 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-211b030d-e9aa-4f37-9ffc-3c200cc76f69 req-2dfb36ed-e590-4a11-90b2-df52c191dd2d service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:37.677692 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:20:37.678890 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:20:37.679959 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:20:37.680846 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:20:37.681993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:20:37.695566 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-211b030d-e9aa-4f37-9ffc-3c200cc76f69 req-2dfb36ed-e590-4a11-90b2-df52c191dd2d service nova] Creating event network-vif-plugged:f4d37966-d902-4c07-9ee5-4be2e42d1714 for instance ff368667-d93b-4b10-9606-09331ebb857c on hv-cinder-85391 Aug 26 06:20:37.706728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-211b030d-e9aa-4f37-9ffc-3c200cc76f69 req-2dfb36ed-e590-4a11-90b2-df52c191dd2d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109156 Aug 26 06:20:37.708763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 284/548] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:20:37.712539 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:37.714186 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:37.715338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:37.716451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-77447e45-c041-4df5-8c97-c1c48e251ea1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:37.717283 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-77447e45-c041-4df5-8c97-c1c48e251ea1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:37.717497 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:37.718330 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:37.719549 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:37.725594 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77447e45-c041-4df5-8c97-c1c48e251ea1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:37.726709 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77447e45-c041-4df5-8c97-c1c48e251ea1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:37.727492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77447e45-c041-4df5-8c97-c1c48e251ea1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:37.728489 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77447e45-c041-4df5-8c97-c1c48e251ea1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:37.729176 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77447e45-c041-4df5-8c97-c1c48e251ea1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:37.729814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-77447e45-c041-4df5-8c97-c1c48e251ea1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:37.802264 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Getting quotas for project 7e90dec3a44a4763b0045af64212fc15. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:20:37.811562 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Getting quotas for user 543a9cddd92a44c78c26e5b8400e0c98 and project 7e90dec3a44a4763b0045af64212fc15. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:20:37.839056 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:20:37.843272 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:20:38.147833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5c1ee71b-e39f-4e92-a674-fb0bde4bcd40 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.461991 Aug 26 06:20:38.155103 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 265/549] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:20:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:20:38.166943 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b9380272-6aba-4cef-8c45-443df9c08986 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:38.166943 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b9380272-6aba-4cef-8c45-443df9c08986 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:38.181991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9380272-6aba-4cef-8c45-443df9c08986 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:38.186222 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9380272-6aba-4cef-8c45-443df9c08986 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:38.188025 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9380272-6aba-4cef-8c45-443df9c08986 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:38.195581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9380272-6aba-4cef-8c45-443df9c08986 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:38.196053 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9380272-6aba-4cef-8c45-443df9c08986 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:38.196503 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b9380272-6aba-4cef-8c45-443df9c08986 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:38.348528 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b9380272-6aba-4cef-8c45-443df9c08986 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:38.362949 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b9380272-6aba-4cef-8c45-443df9c08986 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1265 microversion: 2.1 time: 0.205667 Aug 26 06:20:38.383043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 266/550] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:38 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:38.383043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6f3fa4a2-487b-4b7d-9c1c-2368f82051b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:38.383043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6f3fa4a2-487b-4b7d-9c1c-2368f82051b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:38.390595 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f3fa4a2-487b-4b7d-9c1c-2368f82051b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:38.391228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f3fa4a2-487b-4b7d-9c1c-2368f82051b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:38.391911 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f3fa4a2-487b-4b7d-9c1c-2368f82051b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:38.392770 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f3fa4a2-487b-4b7d-9c1c-2368f82051b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:38.393325 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f3fa4a2-487b-4b7d-9c1c-2368f82051b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:38.395413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6f3fa4a2-487b-4b7d-9c1c-2368f82051b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:38.593724 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-77447e45-c041-4df5-8c97-c1c48e251ea1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:38.609828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-77447e45-c041-4df5-8c97-c1c48e251ea1 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1662 microversion: 2.1 time: 0.899384 Aug 26 06:20:38.610416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 285/551] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:37 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1662 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:38.622892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:38.623788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:38.639619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:38.641467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:38.642100 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:38.643675 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:38.645876 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:38.647228 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:38.734083 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6f3fa4a2-487b-4b7d-9c1c-2368f82051b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:38.747461 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6f3fa4a2-487b-4b7d-9c1c-2368f82051b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.370511 Aug 26 06:20:38.748279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 267/552] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:38 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:38.753358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0dc76ac6-a849-4173-9e25-909cd1e7b976 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:38.754527 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0dc76ac6-a849-4173-9e25-909cd1e7b976 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:38.867505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0dc76ac6-a849-4173-9e25-909cd1e7b976 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:38.878948 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0dc76ac6-a849-4173-9e25-909cd1e7b976 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1218 microversion: 2.1 time: 0.129665 Aug 26 06:20:38.879896 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 268/553] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:38 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:38.887216 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9eb9b18d-87bc-4018-8426-b867098179e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:38.888262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9eb9b18d-87bc-4018-8426-b867098179e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:38.927519 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9eb9b18d-87bc-4018-8426-b867098179e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:38.927956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9eb9b18d-87bc-4018-8426-b867098179e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:38.929066 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9eb9b18d-87bc-4018-8426-b867098179e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:38.929317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9eb9b18d-87bc-4018-8426-b867098179e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:38.929637 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9eb9b18d-87bc-4018-8426-b867098179e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:38.930101 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9eb9b18d-87bc-4018-8426-b867098179e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:39.033091 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:39.049120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:39.051786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:39.053056 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3fbcd8f0-667d-42c4-bc39-8c9a27a2c6f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.440748 Aug 26 06:20:39.053623 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 286/554] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:38 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:39.175567 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9eb9b18d-87bc-4018-8426-b867098179e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:39.188531 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9eb9b18d-87bc-4018-8426-b867098179e1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.307136 Aug 26 06:20:39.189165 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 269/555] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:38 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:39.400902 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-43ff9b9c-bae6-46ea-9805-f790635ae650 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:39.401933 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-43ff9b9c-bae6-46ea-9805-f790635ae650 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:39.421223 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43ff9b9c-bae6-46ea-9805-f790635ae650 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:39.424371 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43ff9b9c-bae6-46ea-9805-f790635ae650 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:39.424828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43ff9b9c-bae6-46ea-9805-f790635ae650 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:39.430998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43ff9b9c-bae6-46ea-9805-f790635ae650 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:39.431674 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43ff9b9c-bae6-46ea-9805-f790635ae650 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:39.432518 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-43ff9b9c-bae6-46ea-9805-f790635ae650 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:39.479559 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-ed18ebc4-ffac-4f99-9977-c388c57263b0 req-7612f9de-fd40-477a-bd69-8b460c079687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f739aa85-1e49-4e21-ab74-9463ba8ffd4c", "tag": "61f75c3c-a587-4be9-a681-7f29d66f4b4c"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:39.498526 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-ed18ebc4-ffac-4f99-9977-c388c57263b0 req-7612f9de-fd40-477a-bd69-8b460c079687 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:39.499036 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-ed18ebc4-ffac-4f99-9977-c388c57263b0 req-7612f9de-fd40-477a-bd69-8b460c079687 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:39.505343 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-ed18ebc4-ffac-4f99-9977-c388c57263b0 req-7612f9de-fd40-477a-bd69-8b460c079687 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:39.537120 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-ed18ebc4-ffac-4f99-9977-c388c57263b0 req-7612f9de-fd40-477a-bd69-8b460c079687 service nova] Creating event network-changed:61f75c3c-a587-4be9-a681-7f29d66f4b4c for instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c on hv-cinder-85391 Aug 26 06:20:39.544664 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-ed18ebc4-ffac-4f99-9977-c388c57263b0 req-7612f9de-fd40-477a-bd69-8b460c079687 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075537 Aug 26 06:20:39.546453 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 270/556] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:20:39.599590 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-43ff9b9c-bae6-46ea-9805-f790635ae650 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:39.625844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-43ff9b9c-bae6-46ea-9805-f790635ae650 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1273 microversion: 2.1 time: 0.233902 Aug 26 06:20:39.643026 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 287/557] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:39 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:39.661608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-39cb67c3-0c4f-439c-a260-bec3de11e772 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:39.664620 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-39cb67c3-0c4f-439c-a260-bec3de11e772 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:39.703650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-39cb67c3-0c4f-439c-a260-bec3de11e772 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:39.705228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-39cb67c3-0c4f-439c-a260-bec3de11e772 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:39.705915 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-39cb67c3-0c4f-439c-a260-bec3de11e772 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:39.708481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-39cb67c3-0c4f-439c-a260-bec3de11e772 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:39.709147 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-39cb67c3-0c4f-439c-a260-bec3de11e772 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:39.709751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-39cb67c3-0c4f-439c-a260-bec3de11e772 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:39.715100 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:39.780859 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9fe07caa-4966-48a9-bbf2-227f1149d06a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:39.786848 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9fe07caa-4966-48a9-bbf2-227f1149d06a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:39.817926 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9fe07caa-4966-48a9-bbf2-227f1149d06a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:39.823740 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9fe07caa-4966-48a9-bbf2-227f1149d06a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:39.834420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9fe07caa-4966-48a9-bbf2-227f1149d06a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:39.834420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9fe07caa-4966-48a9-bbf2-227f1149d06a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:39.834420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9fe07caa-4966-48a9-bbf2-227f1149d06a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:39.834420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9fe07caa-4966-48a9-bbf2-227f1149d06a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:39.986240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-39cb67c3-0c4f-439c-a260-bec3de11e772 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:40.000756 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-39cb67c3-0c4f-439c-a260-bec3de11e772 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1662 microversion: 2.1 time: 0.345797 Aug 26 06:20:40.018124 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 271/558] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:39 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1662 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:40.023265 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9fe07caa-4966-48a9-bbf2-227f1149d06a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:40.028889 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a14065ef-c3a2-41bc-b83f-df598259d2da tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:40.030037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a14065ef-c3a2-41bc-b83f-df598259d2da tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:40.038610 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9fe07caa-4966-48a9-bbf2-227f1149d06a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.271709 Aug 26 06:20:40.041620 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 288/559] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:39 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:40.110501 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:40.114611 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:40.140006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:40.140833 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:40.142951 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:40.144996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:40.148801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:40.151408 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:40.205092 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a14065ef-c3a2-41bc-b83f-df598259d2da tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:40.220530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a14065ef-c3a2-41bc-b83f-df598259d2da tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1218 microversion: 2.1 time: 0.207208 Aug 26 06:20:40.223912 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 272/560] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:40 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1218 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:40.249090 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-367e0eec-beab-4023-b333-2d845cf95c76 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:40.250078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-367e0eec-beab-4023-b333-2d845cf95c76 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:40.267272 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-367e0eec-beab-4023-b333-2d845cf95c76 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:40.268165 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-367e0eec-beab-4023-b333-2d845cf95c76 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:40.268846 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-367e0eec-beab-4023-b333-2d845cf95c76 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:40.270553 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-367e0eec-beab-4023-b333-2d845cf95c76 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:40.271296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-367e0eec-beab-4023-b333-2d845cf95c76 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:40.272183 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-367e0eec-beab-4023-b333-2d845cf95c76 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:40.514866 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-367e0eec-beab-4023-b333-2d845cf95c76 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:40.551435 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-367e0eec-beab-4023-b333-2d845cf95c76 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.326485 Aug 26 06:20:40.565652 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 273/561] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:40 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:40.609064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:40.621879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:40.625811 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:40.627241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6bfe8bd3-48d3-4492-829c-9c007b83f8ea tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.531146 Aug 26 06:20:40.645729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 289/562] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:40 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:40.673326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f9e7e189-7d88-4041-86db-0c6921439358 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:40.674900 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f9e7e189-7d88-4041-86db-0c6921439358 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:40.685332 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9e7e189-7d88-4041-86db-0c6921439358 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:40.686231 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9e7e189-7d88-4041-86db-0c6921439358 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:40.687057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9e7e189-7d88-4041-86db-0c6921439358 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:40.688328 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9e7e189-7d88-4041-86db-0c6921439358 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:40.689175 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9e7e189-7d88-4041-86db-0c6921439358 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:40.689961 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9e7e189-7d88-4041-86db-0c6921439358 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:40.807881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f9e7e189-7d88-4041-86db-0c6921439358 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:40.818271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f9e7e189-7d88-4041-86db-0c6921439358 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1271 microversion: 2.1 time: 0.151054 Aug 26 06:20:40.819034 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 274/563] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:40 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:41.034354 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-65a772bb-52fa-4b9e-8871-16dd047b5d8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:41.035836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-65a772bb-52fa-4b9e-8871-16dd047b5d8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:41.065421 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65a772bb-52fa-4b9e-8871-16dd047b5d8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:41.072638 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5a165929-277b-4a54-a05a-e039b72e83d7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:41.075767 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5a165929-277b-4a54-a05a-e039b72e83d7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:41.078586 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65a772bb-52fa-4b9e-8871-16dd047b5d8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:41.079474 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65a772bb-52fa-4b9e-8871-16dd047b5d8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:41.083586 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65a772bb-52fa-4b9e-8871-16dd047b5d8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:41.099369 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65a772bb-52fa-4b9e-8871-16dd047b5d8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:41.104147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65a772bb-52fa-4b9e-8871-16dd047b5d8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:41.109287 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a165929-277b-4a54-a05a-e039b72e83d7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:41.112264 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a165929-277b-4a54-a05a-e039b72e83d7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:41.127393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a165929-277b-4a54-a05a-e039b72e83d7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:41.127393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a165929-277b-4a54-a05a-e039b72e83d7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:41.127393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a165929-277b-4a54-a05a-e039b72e83d7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:41.127393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5a165929-277b-4a54-a05a-e039b72e83d7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:41.542500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5a165929-277b-4a54-a05a-e039b72e83d7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:41.562725 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5a165929-277b-4a54-a05a-e039b72e83d7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1359 microversion: 2.1 time: 0.495161 Aug 26 06:20:41.569937 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 275/564] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:41 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1359 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:41.576730 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-24f061d6-a39c-4977-9009-88de08d54f49 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:41.577455 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-24f061d6-a39c-4977-9009-88de08d54f49 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:41.584411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24f061d6-a39c-4977-9009-88de08d54f49 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:41.586118 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24f061d6-a39c-4977-9009-88de08d54f49 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:41.586730 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24f061d6-a39c-4977-9009-88de08d54f49 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:41.587592 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24f061d6-a39c-4977-9009-88de08d54f49 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:41.588085 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24f061d6-a39c-4977-9009-88de08d54f49 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:41.588710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24f061d6-a39c-4977-9009-88de08d54f49 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:41.693074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-65a772bb-52fa-4b9e-8871-16dd047b5d8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:41.708014 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-24f061d6-a39c-4977-9009-88de08d54f49 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:41.720796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-24f061d6-a39c-4977-9009-88de08d54f49 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1214 microversion: 2.1 time: 0.148751 Aug 26 06:20:41.721274 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-65a772bb-52fa-4b9e-8871-16dd047b5d8b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1666 microversion: 2.1 time: 0.685335 Aug 26 06:20:41.723260 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 290/565] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:41 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1666 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:41.724098 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 276/566] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:41 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:41.737184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f1f64860-6184-49b5-9007-1c83afd100f0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:41.737923 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f1f64860-6184-49b5-9007-1c83afd100f0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:41.747462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:41.748361 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:41.771754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1f64860-6184-49b5-9007-1c83afd100f0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:41.772501 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1f64860-6184-49b5-9007-1c83afd100f0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:41.772774 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1f64860-6184-49b5-9007-1c83afd100f0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:41.773185 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:41.773324 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1f64860-6184-49b5-9007-1c83afd100f0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:41.773777 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1f64860-6184-49b5-9007-1c83afd100f0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:41.774131 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:41.774280 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f1f64860-6184-49b5-9007-1c83afd100f0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:41.774949 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:41.776000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:41.776618 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:41.777405 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:42.052635 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:42.067532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:42.070458 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:42.072381 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3eef0194-2cdc-4b0c-9e20-fd46b4a5193c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.346999 Aug 26 06:20:42.073308 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 277/567] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:41 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:42.083083 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fd947d18-b839-47c1-8914-452d6aa76916 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:42.084573 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fd947d18-b839-47c1-8914-452d6aa76916 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:42.091961 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd947d18-b839-47c1-8914-452d6aa76916 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:42.092545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd947d18-b839-47c1-8914-452d6aa76916 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:42.093091 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd947d18-b839-47c1-8914-452d6aa76916 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:42.093999 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd947d18-b839-47c1-8914-452d6aa76916 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:42.094604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd947d18-b839-47c1-8914-452d6aa76916 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:42.095084 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd947d18-b839-47c1-8914-452d6aa76916 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:42.183629 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fd947d18-b839-47c1-8914-452d6aa76916 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:42.195885 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fd947d18-b839-47c1-8914-452d6aa76916 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1271 microversion: 2.1 time: 0.119939 Aug 26 06:20:42.196578 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 278/568] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:42 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:42.554836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f1f64860-6184-49b5-9007-1c83afd100f0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:42.569411 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f1f64860-6184-49b5-9007-1c83afd100f0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.843960 Aug 26 06:20:42.570413 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 291/569] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:41 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:42.609729 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c3beaf3c-1d72-41a5-b792-904975bc08ae tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:42.610612 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c3beaf3c-1d72-41a5-b792-904975bc08ae tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:42.621932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c3beaf3c-1d72-41a5-b792-904975bc08ae tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:42.623090 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c3beaf3c-1d72-41a5-b792-904975bc08ae tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:42.629978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c3beaf3c-1d72-41a5-b792-904975bc08ae tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:42.629978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c3beaf3c-1d72-41a5-b792-904975bc08ae tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:42.629978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c3beaf3c-1d72-41a5-b792-904975bc08ae tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:42.629978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c3beaf3c-1d72-41a5-b792-904975bc08ae tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:42.763771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-070f7842-1f4f-4f3f-9d83-36b735c351c3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:42.765361 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-070f7842-1f4f-4f3f-9d83-36b735c351c3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:42.774060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-070f7842-1f4f-4f3f-9d83-36b735c351c3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:42.774712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-070f7842-1f4f-4f3f-9d83-36b735c351c3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:42.775303 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-070f7842-1f4f-4f3f-9d83-36b735c351c3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:42.776044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-070f7842-1f4f-4f3f-9d83-36b735c351c3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:42.776858 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-070f7842-1f4f-4f3f-9d83-36b735c351c3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:42.777999 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-070f7842-1f4f-4f3f-9d83-36b735c351c3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:42.855026 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c3beaf3c-1d72-41a5-b792-904975bc08ae tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:42.881544 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c3beaf3c-1d72-41a5-b792-904975bc08ae tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1550 microversion: 2.1 time: 0.278628 Aug 26 06:20:42.888032 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 279/570] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:42 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1550 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:42.915735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-02c77a7f-ef31-45bd-8c8f-760e0d431752 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:42.917039 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-02c77a7f-ef31-45bd-8c8f-760e0d431752 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:42.929612 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c77a7f-ef31-45bd-8c8f-760e0d431752 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:42.931650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c77a7f-ef31-45bd-8c8f-760e0d431752 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:42.932849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c77a7f-ef31-45bd-8c8f-760e0d431752 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:42.934268 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c77a7f-ef31-45bd-8c8f-760e0d431752 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:42.935292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c77a7f-ef31-45bd-8c8f-760e0d431752 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:42.936258 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-02c77a7f-ef31-45bd-8c8f-760e0d431752 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:42.936939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-070f7842-1f4f-4f3f-9d83-36b735c351c3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:42.946951 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-070f7842-1f4f-4f3f-9d83-36b735c351c3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1214 microversion: 2.1 time: 0.188167 Aug 26 06:20:42.952147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 292/571] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:42 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:43.121396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:43.128632 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:43.161570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:43.162109 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:43.167985 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:43.168698 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:43.169352 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:43.170230 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:43.243257 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-02c77a7f-ef31-45bd-8c8f-760e0d431752 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:43.256594 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-02c77a7f-ef31-45bd-8c8f-760e0d431752 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1550 microversion: 2.1 time: 0.350617 Aug 26 06:20:43.258497 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 280/572] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:42 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1550 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:43.264364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d78dd7a8-6507-4d0c-8543-d881df3c91ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:43.266005 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d78dd7a8-6507-4d0c-8543-d881df3c91ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:43.288230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d78dd7a8-6507-4d0c-8543-d881df3c91ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:43.289955 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d78dd7a8-6507-4d0c-8543-d881df3c91ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:43.290721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d78dd7a8-6507-4d0c-8543-d881df3c91ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:43.291801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d78dd7a8-6507-4d0c-8543-d881df3c91ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:43.293363 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d78dd7a8-6507-4d0c-8543-d881df3c91ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:43.294188 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d78dd7a8-6507-4d0c-8543-d881df3c91ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:43.627636 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d78dd7a8-6507-4d0c-8543-d881df3c91ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:43.639565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:43.648593 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:43.654373 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:43.656975 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d78dd7a8-6507-4d0c-8543-d881df3c91ff tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.394545 Aug 26 06:20:43.659165 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 281/573] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:43 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:43.673763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-30725fd5-d6d6-4da1-8002-fce80e395e1a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.567519 Aug 26 06:20:43.687078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 293/574] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:43 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:43.697694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-097e4e0a-8139-477a-abfc-4ad703fb5eb1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:43.703863 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6d179ffc-3585-407c-a532-3f8fa15850d4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:43.705034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6d179ffc-3585-407c-a532-3f8fa15850d4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:43.716306 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-097e4e0a-8139-477a-abfc-4ad703fb5eb1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:43.717913 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-097e4e0a-8139-477a-abfc-4ad703fb5eb1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Searching by: {'deleted': False, 'project_id': '01817da1260c41b4abe6f02b11c66232'} {{(pid=121344) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 26 06:20:43.733800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:43.739745 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-097e4e0a-8139-477a-abfc-4ad703fb5eb1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:43.741436 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-097e4e0a-8139-477a-abfc-4ad703fb5eb1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:43.742431 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-097e4e0a-8139-477a-abfc-4ad703fb5eb1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:43.743568 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d179ffc-3585-407c-a532-3f8fa15850d4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:43.744448 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d179ffc-3585-407c-a532-3f8fa15850d4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:43.745223 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d179ffc-3585-407c-a532-3f8fa15850d4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:43.745596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-097e4e0a-8139-477a-abfc-4ad703fb5eb1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:43.746348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d179ffc-3585-407c-a532-3f8fa15850d4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:43.746824 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-097e4e0a-8139-477a-abfc-4ad703fb5eb1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:43.747656 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-097e4e0a-8139-477a-abfc-4ad703fb5eb1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:43.757033 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d179ffc-3585-407c-a532-3f8fa15850d4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:43.758679 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d179ffc-3585-407c-a532-3f8fa15850d4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:43.981564 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.multi_cell_list [None req-097e4e0a-8139-477a-abfc-4ad703fb5eb1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121344) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 26 06:20:44.014263 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6d179ffc-3585-407c-a532-3f8fa15850d4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:44.033343 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6d179ffc-3585-407c-a532-3f8fa15850d4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.342029 Aug 26 06:20:44.033877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 294/575] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:43 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:44.047113 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b4781454-469a-48a6-b7b6-95ae08f53657 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:44.047113 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b4781454-469a-48a6-b7b6-95ae08f53657 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:44.058340 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b4781454-469a-48a6-b7b6-95ae08f53657 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:44.058787 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b4781454-469a-48a6-b7b6-95ae08f53657 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:44.059229 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b4781454-469a-48a6-b7b6-95ae08f53657 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:44.060017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b4781454-469a-48a6-b7b6-95ae08f53657 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:44.060477 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b4781454-469a-48a6-b7b6-95ae08f53657 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:44.060905 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b4781454-469a-48a6-b7b6-95ae08f53657 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:44.119146 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-097e4e0a-8139-477a-abfc-4ad703fb5eb1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.455526 Aug 26 06:20:44.119741 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 282/576] 10.222.0.40 () {58 vars in 1125 bytes} [Fri Aug 26 06:20:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:20:44.150186 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b6ab5f5b-b7dd-4851-b798-85ff9e225fe0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:44.150836 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b6ab5f5b-b7dd-4851-b798-85ff9e225fe0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:44.165278 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6ab5f5b-b7dd-4851-b798-85ff9e225fe0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:44.166491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6ab5f5b-b7dd-4851-b798-85ff9e225fe0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:44.167086 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6ab5f5b-b7dd-4851-b798-85ff9e225fe0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:44.169119 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6ab5f5b-b7dd-4851-b798-85ff9e225fe0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:44.169596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6ab5f5b-b7dd-4851-b798-85ff9e225fe0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:44.170050 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6ab5f5b-b7dd-4851-b798-85ff9e225fe0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:44.234570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b4781454-469a-48a6-b7b6-95ae08f53657 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:44.252968 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b4781454-469a-48a6-b7b6-95ae08f53657 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1270 microversion: 2.1 time: 0.217809 Aug 26 06:20:44.259374 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 295/577] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:44 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1270 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:44.468375 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b6ab5f5b-b7dd-4851-b798-85ff9e225fe0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:44.483817 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b6ab5f5b-b7dd-4851-b798-85ff9e225fe0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1550 microversion: 2.1 time: 0.343055 Aug 26 06:20:44.500493 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 283/578] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:44 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1550 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:44.681772 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-775f4dfe-a0f0-4952-8cae-13023667bc21 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:44.683619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-775f4dfe-a0f0-4952-8cae-13023667bc21 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:44.709787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:44.711663 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:44.714956 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-775f4dfe-a0f0-4952-8cae-13023667bc21 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:44.721679 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-775f4dfe-a0f0-4952-8cae-13023667bc21 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:44.725529 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-775f4dfe-a0f0-4952-8cae-13023667bc21 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:44.727424 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-775f4dfe-a0f0-4952-8cae-13023667bc21 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:44.729088 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-775f4dfe-a0f0-4952-8cae-13023667bc21 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:44.731691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-775f4dfe-a0f0-4952-8cae-13023667bc21 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:44.757214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:44.764932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:44.766702 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:44.770225 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:44.771006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:44.772365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:44.859521 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:45.081679 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:45.119378 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:45.122487 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:45.125130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c7c05672-2363-4130-a287-f3eb2de55892 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.422369 Aug 26 06:20:45.136510 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 284/579] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:44 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:45.165107 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0e14bae0-9de8-4914-8d35-0fac0e68938e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:45.166013 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0e14bae0-9de8-4914-8d35-0fac0e68938e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:45.213207 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e14bae0-9de8-4914-8d35-0fac0e68938e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:45.218073 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e14bae0-9de8-4914-8d35-0fac0e68938e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:45.224219 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e14bae0-9de8-4914-8d35-0fac0e68938e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:45.227171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e14bae0-9de8-4914-8d35-0fac0e68938e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:45.229656 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e14bae0-9de8-4914-8d35-0fac0e68938e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:45.234157 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e14bae0-9de8-4914-8d35-0fac0e68938e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:45.348643 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-775f4dfe-a0f0-4952-8cae-13023667bc21 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:45.370517 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-775f4dfe-a0f0-4952-8cae-13023667bc21 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.687179 Aug 26 06:20:45.371441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 296/580] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:44 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:45.390442 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9e86e974-2b6f-45f0-881a-2dbbd8e5bca9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:45.401720 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9e86e974-2b6f-45f0-881a-2dbbd8e5bca9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:45.409279 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e86e974-2b6f-45f0-881a-2dbbd8e5bca9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:45.409763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e86e974-2b6f-45f0-881a-2dbbd8e5bca9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:45.411142 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e86e974-2b6f-45f0-881a-2dbbd8e5bca9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:45.412135 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e86e974-2b6f-45f0-881a-2dbbd8e5bca9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:45.412597 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e86e974-2b6f-45f0-881a-2dbbd8e5bca9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:45.413019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e86e974-2b6f-45f0-881a-2dbbd8e5bca9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:45.559877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9e86e974-2b6f-45f0-881a-2dbbd8e5bca9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:45.577127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9e86e974-2b6f-45f0-881a-2dbbd8e5bca9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1278 microversion: 2.1 time: 0.197004 Aug 26 06:20:45.577723 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 297/581] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:45 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:45.631632 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0e14bae0-9de8-4914-8d35-0fac0e68938e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:45.651947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0e14bae0-9de8-4914-8d35-0fac0e68938e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.498154 Aug 26 06:20:45.674341 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 285/582] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:45 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:46.174138 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:46.175925 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:46.186217 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:46.187037 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:46.187650 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:46.188700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:46.189863 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:46.190505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:46.427948 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-07a6702e-8ba8-42b1-8014-8a6bc300bd35 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:46.430123 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-07a6702e-8ba8-42b1-8014-8a6bc300bd35 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:46.474910 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-07a6702e-8ba8-42b1-8014-8a6bc300bd35 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:46.475991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-07a6702e-8ba8-42b1-8014-8a6bc300bd35 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:46.477440 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-07a6702e-8ba8-42b1-8014-8a6bc300bd35 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:46.480090 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-07a6702e-8ba8-42b1-8014-8a6bc300bd35 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:46.483280 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-07a6702e-8ba8-42b1-8014-8a6bc300bd35 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:46.483767 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-07a6702e-8ba8-42b1-8014-8a6bc300bd35 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:46.748607 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:46.788969 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:46.811496 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:46.814880 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c22d19c2-ed84-498d-8ccc-25272c8629c7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.644050 Aug 26 06:20:46.815960 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 298/583] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:46 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:46.831370 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-07a6702e-8ba8-42b1-8014-8a6bc300bd35 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:46.845903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d651f8af-14cd-477d-be40-7e74d7c98c4a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:46.845903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d651f8af-14cd-477d-be40-7e74d7c98c4a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:46.860054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-07a6702e-8ba8-42b1-8014-8a6bc300bd35 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.465657 Aug 26 06:20:46.865285 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 286/584] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:46 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:46.880141 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d651f8af-14cd-477d-be40-7e74d7c98c4a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:46.883474 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-df194219-4080-4ce4-a0c7-d4eccc18a24d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:46.884502 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-df194219-4080-4ce4-a0c7-d4eccc18a24d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:46.885525 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d651f8af-14cd-477d-be40-7e74d7c98c4a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:46.890773 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d651f8af-14cd-477d-be40-7e74d7c98c4a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:46.896613 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d651f8af-14cd-477d-be40-7e74d7c98c4a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:46.896613 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d651f8af-14cd-477d-be40-7e74d7c98c4a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:46.896613 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d651f8af-14cd-477d-be40-7e74d7c98c4a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:46.902874 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df194219-4080-4ce4-a0c7-d4eccc18a24d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:46.903548 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df194219-4080-4ce4-a0c7-d4eccc18a24d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:46.903993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df194219-4080-4ce4-a0c7-d4eccc18a24d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:46.910826 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df194219-4080-4ce4-a0c7-d4eccc18a24d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:46.911993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df194219-4080-4ce4-a0c7-d4eccc18a24d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:46.912765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df194219-4080-4ce4-a0c7-d4eccc18a24d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:47.076033 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d651f8af-14cd-477d-be40-7e74d7c98c4a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:47.106873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d651f8af-14cd-477d-be40-7e74d7c98c4a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1276 microversion: 2.1 time: 0.271750 Aug 26 06:20:47.106873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 299/585] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:46 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1276 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:47.106873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-1a896026-10b6-4c5b-a837-43f93c52ae87 req-caf36410-0835-48ce-8d8e-431bfa3802d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac54c89b-a0e4-4948-8da6-e9627afd22d4", "tag": "8caf9b6b-dcf3-478e-8706-d6a2f2a69cde"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:47.137993 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1a896026-10b6-4c5b-a837-43f93c52ae87 req-caf36410-0835-48ce-8d8e-431bfa3802d4 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:47.139110 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1a896026-10b6-4c5b-a837-43f93c52ae87 req-caf36410-0835-48ce-8d8e-431bfa3802d4 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:47.140241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1a896026-10b6-4c5b-a837-43f93c52ae87 req-caf36410-0835-48ce-8d8e-431bfa3802d4 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:47.157294 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-1a896026-10b6-4c5b-a837-43f93c52ae87 req-caf36410-0835-48ce-8d8e-431bfa3802d4 service nova] Creating event network-changed:8caf9b6b-dcf3-478e-8706-d6a2f2a69cde for instance ac54c89b-a0e4-4948-8da6-e9627afd22d4 on hv-cinder-85391 Aug 26 06:20:47.165462 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-1a896026-10b6-4c5b-a837-43f93c52ae87 req-caf36410-0835-48ce-8d8e-431bfa3802d4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065963 Aug 26 06:20:47.166292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 300/586] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:20:47.220143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-df194219-4080-4ce4-a0c7-d4eccc18a24d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:47.230126 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-df194219-4080-4ce4-a0c7-d4eccc18a24d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.358132 Aug 26 06:20:47.235636 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 287/587] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:46 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:47.852450 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:47.857825 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e6051cae-5f79-433f-b531-b22f74644b19 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:47.862458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:47.869903 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e6051cae-5f79-433f-b531-b22f74644b19 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:47.889406 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:47.889900 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:47.890353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:47.892270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6051cae-5f79-433f-b531-b22f74644b19 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:47.893214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6051cae-5f79-433f-b531-b22f74644b19 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:47.893895 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6051cae-5f79-433f-b531-b22f74644b19 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:47.894852 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:47.895824 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6051cae-5f79-433f-b531-b22f74644b19 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:47.896522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:47.897197 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6051cae-5f79-433f-b531-b22f74644b19 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:47.897969 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:47.899471 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6051cae-5f79-433f-b531-b22f74644b19 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:47.970494 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:47.999035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-e6051cae-5f79-433f-b531-b22f74644b19 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lazy-loading 'flavor' on Instance uuid 45330505-4b58-4762-bb9f-e704f9648e1e {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:20:48.329830 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:48.357421 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:48.368068 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:48.369654 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-26cd6c60-1b34-4ec2-be27-b333e8099440 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.530623 Aug 26 06:20:48.370401 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 301/588] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:47 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:48.377991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4348d74f-3892-4e20-82d5-a7bfba54146f tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:48.379292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4348d74f-3892-4e20-82d5-a7bfba54146f tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:48.401663 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4348d74f-3892-4e20-82d5-a7bfba54146f tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:48.406755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4348d74f-3892-4e20-82d5-a7bfba54146f tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:48.407634 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4348d74f-3892-4e20-82d5-a7bfba54146f tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:48.408628 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4348d74f-3892-4e20-82d5-a7bfba54146f tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:48.411992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4348d74f-3892-4e20-82d5-a7bfba54146f tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:48.413235 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4348d74f-3892-4e20-82d5-a7bfba54146f tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:48.615970 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4348d74f-3892-4e20-82d5-a7bfba54146f tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:48.628180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4348d74f-3892-4e20-82d5-a7bfba54146f tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.255189 Aug 26 06:20:48.629561 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 302/589] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:48 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:48.638345 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-57c449d2-a3ca-4ae9-8143-9629bca15eb3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:48.639531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-57c449d2-a3ca-4ae9-8143-9629bca15eb3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:48.651551 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-57c449d2-a3ca-4ae9-8143-9629bca15eb3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:48.653598 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-57c449d2-a3ca-4ae9-8143-9629bca15eb3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:48.654519 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-57c449d2-a3ca-4ae9-8143-9629bca15eb3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:48.655818 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-57c449d2-a3ca-4ae9-8143-9629bca15eb3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:48.656431 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-57c449d2-a3ca-4ae9-8143-9629bca15eb3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:48.656962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-57c449d2-a3ca-4ae9-8143-9629bca15eb3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:48.830565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-57c449d2-a3ca-4ae9-8143-9629bca15eb3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:48.841047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-57c449d2-a3ca-4ae9-8143-9629bca15eb3 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.210069 Aug 26 06:20:48.841691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 303/590] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:48 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:48.846981 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ed2261b0-8004-4493-ac48-fc377dfb79c8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baf57c4b-81d0-478a-bccd-140904f07eda"}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:48.857338 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ed2261b0-8004-4493-ac48-fc377dfb79c8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:48.865186 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed2261b0-8004-4493-ac48-fc377dfb79c8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:48.865588 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed2261b0-8004-4493-ac48-fc377dfb79c8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:48.866019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed2261b0-8004-4493-ac48-fc377dfb79c8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:48.866751 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed2261b0-8004-4493-ac48-fc377dfb79c8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:48.867187 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed2261b0-8004-4493-ac48-fc377dfb79c8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:48.867602 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ed2261b0-8004-4493-ac48-fc377dfb79c8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:49.926932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e6051cae-5f79-433f-b531-b22f74644b19 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "POST /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/action" status: 200 len: 32 microversion: 2.1 time: 2.082396 Aug 26 06:20:49.926932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 288/591] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:20:47 2022] POST /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/action => generated 32 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 06:20:49.936376 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-bb3988af-db01-42a2-a6fe-222f8ca7057a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:49.937439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-bb3988af-db01-42a2-a6fe-222f8ca7057a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:49.953242 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bb3988af-db01-42a2-a6fe-222f8ca7057a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:49.953735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bb3988af-db01-42a2-a6fe-222f8ca7057a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:49.954175 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bb3988af-db01-42a2-a6fe-222f8ca7057a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:49.955330 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bb3988af-db01-42a2-a6fe-222f8ca7057a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:49.956410 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bb3988af-db01-42a2-a6fe-222f8ca7057a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:49.958020 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bb3988af-db01-42a2-a6fe-222f8ca7057a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:50.157737 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-bb3988af-db01-42a2-a6fe-222f8ca7057a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:50.168526 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-bb3988af-db01-42a2-a6fe-222f8ca7057a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.240719 Aug 26 06:20:50.170132 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 289/592] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:49 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:50.177125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:50.177125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:50.184953 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:50.185738 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:50.186377 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:50.187343 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:50.188185 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:50.188906 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:50.216826 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=20 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:50.438691 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:50.456515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:50.461171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:50.464028 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6c31d3b8-e5d3-45e5-92da-0bdf7c12b0a4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.292160 Aug 26 06:20:50.465923 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 290/593] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:50 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:50.476900 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0989c2cd-b6fc-4a49-976f-7490bc73d134 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:50.484072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0989c2cd-b6fc-4a49-976f-7490bc73d134 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:50.525203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0989c2cd-b6fc-4a49-976f-7490bc73d134 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:50.526409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0989c2cd-b6fc-4a49-976f-7490bc73d134 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:50.527639 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0989c2cd-b6fc-4a49-976f-7490bc73d134 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:50.529514 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0989c2cd-b6fc-4a49-976f-7490bc73d134 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:50.530445 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0989c2cd-b6fc-4a49-976f-7490bc73d134 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:50.531577 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0989c2cd-b6fc-4a49-976f-7490bc73d134 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:50.835332 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0989c2cd-b6fc-4a49-976f-7490bc73d134 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:50.853525 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0989c2cd-b6fc-4a49-976f-7490bc73d134 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.384881 Aug 26 06:20:50.855279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 291/594] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:50 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:50.861853 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-89327f30-48e9-44f6-8d39-25345d144ba9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:50.863532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-89327f30-48e9-44f6-8d39-25345d144ba9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:50.874741 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89327f30-48e9-44f6-8d39-25345d144ba9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:50.875623 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89327f30-48e9-44f6-8d39-25345d144ba9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:50.876412 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89327f30-48e9-44f6-8d39-25345d144ba9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:50.877588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89327f30-48e9-44f6-8d39-25345d144ba9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:50.878417 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89327f30-48e9-44f6-8d39-25345d144ba9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:50.879243 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89327f30-48e9-44f6-8d39-25345d144ba9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:51.086450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-89327f30-48e9-44f6-8d39-25345d144ba9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:51.098722 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-89327f30-48e9-44f6-8d39-25345d144ba9 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.241150 Aug 26 06:20:51.111024 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 292/595] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:50 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:51.111024 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5f1a28eb-fb2b-4c3d-adc9-d4d196f9a0c5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:51.111024 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5f1a28eb-fb2b-4c3d-adc9-d4d196f9a0c5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:51.112010 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f1a28eb-fb2b-4c3d-adc9-d4d196f9a0c5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:51.112501 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f1a28eb-fb2b-4c3d-adc9-d4d196f9a0c5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:51.112971 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f1a28eb-fb2b-4c3d-adc9-d4d196f9a0c5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:51.114608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f1a28eb-fb2b-4c3d-adc9-d4d196f9a0c5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:51.115254 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f1a28eb-fb2b-4c3d-adc9-d4d196f9a0c5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:51.115683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5f1a28eb-fb2b-4c3d-adc9-d4d196f9a0c5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:51.333261 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5f1a28eb-fb2b-4c3d-adc9-d4d196f9a0c5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:51.351511 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5f1a28eb-fb2b-4c3d-adc9-d4d196f9a0c5 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.250671 Aug 26 06:20:51.354135 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 293/596] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:51 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:51.360006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3be56904-98e2-4d86-984b-120799df3ee8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:51.361008 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3be56904-98e2-4d86-984b-120799df3ee8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:51.368001 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3be56904-98e2-4d86-984b-120799df3ee8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:51.368866 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3be56904-98e2-4d86-984b-120799df3ee8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:51.369762 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3be56904-98e2-4d86-984b-120799df3ee8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:51.370841 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3be56904-98e2-4d86-984b-120799df3ee8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:51.371462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3be56904-98e2-4d86-984b-120799df3ee8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:51.372047 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3be56904-98e2-4d86-984b-120799df3ee8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:51.616904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3be56904-98e2-4d86-984b-120799df3ee8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:51.625352 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3be56904-98e2-4d86-984b-120799df3ee8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.269934 Aug 26 06:20:51.626204 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 294/597] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:51 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:51.640581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:51.641204 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:51.656093 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:51.656588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:51.657035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:51.657746 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:51.658207 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:51.658647 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:51.865911 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:51.878951 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:51.881006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:51.882356 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8c337568-92b6-4b92-b289-a7b11d20796d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1739 microversion: 2.20 time: 0.254991 Aug 26 06:20:51.894731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 295/598] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:51 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:51.906340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c8381dcc-0aa1-4f44-8f54-5732242fe1fc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:51.906977 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c8381dcc-0aa1-4f44-8f54-5732242fe1fc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:51.922253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8381dcc-0aa1-4f44-8f54-5732242fe1fc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:51.926926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8381dcc-0aa1-4f44-8f54-5732242fe1fc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:51.926926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8381dcc-0aa1-4f44-8f54-5732242fe1fc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:51.926926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8381dcc-0aa1-4f44-8f54-5732242fe1fc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:51.926926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8381dcc-0aa1-4f44-8f54-5732242fe1fc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:51.927481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8381dcc-0aa1-4f44-8f54-5732242fe1fc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:52.054725 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ed2261b0-8004-4493-ac48-fc377dfb79c8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "POST /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.211698 Aug 26 06:20:52.055624 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 304/599] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:20:48 2022] POST /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments => generated 194 bytes in 3213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:20:52.121637 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c8381dcc-0aa1-4f44-8f54-5732242fe1fc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:52.131136 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-581daeee-c2da-4783-b8e1-d7b4703c8b1b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:52.131893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-581daeee-c2da-4783-b8e1-d7b4703c8b1b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:52.139237 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-581daeee-c2da-4783-b8e1-d7b4703c8b1b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:52.139758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-581daeee-c2da-4783-b8e1-d7b4703c8b1b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:52.140193 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-581daeee-c2da-4783-b8e1-d7b4703c8b1b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:52.140910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-581daeee-c2da-4783-b8e1-d7b4703c8b1b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:52.141343 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c8381dcc-0aa1-4f44-8f54-5732242fe1fc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.244924 Aug 26 06:20:52.141740 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-581daeee-c2da-4783-b8e1-d7b4703c8b1b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:52.141928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 296/600] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:51 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:52.142217 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-581daeee-c2da-4783-b8e1-d7b4703c8b1b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:52.385807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-581daeee-c2da-4783-b8e1-d7b4703c8b1b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:52.386460 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0278d8ca-34dd-4e98-a710-5d69b8b111e6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:52.387103 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0278d8ca-34dd-4e98-a710-5d69b8b111e6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:52.393851 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0278d8ca-34dd-4e98-a710-5d69b8b111e6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:52.395241 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0278d8ca-34dd-4e98-a710-5d69b8b111e6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:52.395799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-581daeee-c2da-4783-b8e1-d7b4703c8b1b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.269698 Aug 26 06:20:52.395959 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0278d8ca-34dd-4e98-a710-5d69b8b111e6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:52.396571 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0278d8ca-34dd-4e98-a710-5d69b8b111e6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:52.396688 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 305/601] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:52 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:52.396881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0278d8ca-34dd-4e98-a710-5d69b8b111e6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:52.397392 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0278d8ca-34dd-4e98-a710-5d69b8b111e6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:52.539545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0278d8ca-34dd-4e98-a710-5d69b8b111e6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:52.548707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0278d8ca-34dd-4e98-a710-5d69b8b111e6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.166170 Aug 26 06:20:52.549483 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 297/602] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:52 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:52.652424 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-2f728438-af5f-4966-91d4-0b195511e953 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:52.653289 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-2f728438-af5f-4966-91d4-0b195511e953 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:52.659566 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2f728438-af5f-4966-91d4-0b195511e953 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:52.660382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2f728438-af5f-4966-91d4-0b195511e953 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:52.661029 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2f728438-af5f-4966-91d4-0b195511e953 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:52.661814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2f728438-af5f-4966-91d4-0b195511e953 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:52.662340 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2f728438-af5f-4966-91d4-0b195511e953 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:52.662923 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2f728438-af5f-4966-91d4-0b195511e953 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:52.774987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-eeaf98d5-2897-441b-9894-c21b412f2755 req-8e5646f9-c800-49cd-8f68-e1bcf25a5d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49523656-e2db-453f-a79f-435e6991bacc", "tag": "591cc0d6-3149-4691-91d0-6ea7e9e1679f"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:52.794294 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-eeaf98d5-2897-441b-9894-c21b412f2755 req-8e5646f9-c800-49cd-8f68-e1bcf25a5d25 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:52.797534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-eeaf98d5-2897-441b-9894-c21b412f2755 req-8e5646f9-c800-49cd-8f68-e1bcf25a5d25 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:52.798834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-eeaf98d5-2897-441b-9894-c21b412f2755 req-8e5646f9-c800-49cd-8f68-e1bcf25a5d25 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:52.833902 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-eeaf98d5-2897-441b-9894-c21b412f2755 req-8e5646f9-c800-49cd-8f68-e1bcf25a5d25 service nova] Creating event network-changed:591cc0d6-3149-4691-91d0-6ea7e9e1679f for instance 49523656-e2db-453f-a79f-435e6991bacc on hv-cinder-85391 Aug 26 06:20:52.843365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-eeaf98d5-2897-441b-9894-c21b412f2755 req-8e5646f9-c800-49cd-8f68-e1bcf25a5d25 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074146 Aug 26 06:20:52.844740 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 298/603] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:20:52.866277 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-2f728438-af5f-4966-91d4-0b195511e953 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:52.880751 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-2f728438-af5f-4966-91d4-0b195511e953 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.232266 Aug 26 06:20:52.881323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 306/604] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:52 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:52.914722 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:52.915461 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:52.921731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:52.922500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:52.922962 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:52.923662 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:52.924114 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:52.924538 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:53.082287 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:53.090696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:53.092129 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:53.146340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-24b16275-8ef0-47cc-9c7f-1128dd689cf4 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1721 microversion: 2.20 time: 0.190405 Aug 26 06:20:53.146340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 299/605] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:52 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:53.168854 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-543d8bf0-f942-4137-842b-11cdbd574ba0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:53.170994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-543d8bf0-f942-4137-842b-11cdbd574ba0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:53.183793 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-543d8bf0-f942-4137-842b-11cdbd574ba0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:53.184486 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-543d8bf0-f942-4137-842b-11cdbd574ba0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:53.185033 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-543d8bf0-f942-4137-842b-11cdbd574ba0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:53.186340 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-543d8bf0-f942-4137-842b-11cdbd574ba0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:53.186954 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-543d8bf0-f942-4137-842b-11cdbd574ba0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:53.187479 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-543d8bf0-f942-4137-842b-11cdbd574ba0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:53.416962 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c6be74d2-45fe-4b10-a8be-6364587b604b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:53.417572 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c6be74d2-45fe-4b10-a8be-6364587b604b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:53.424748 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6be74d2-45fe-4b10-a8be-6364587b604b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:53.425244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6be74d2-45fe-4b10-a8be-6364587b604b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:53.426303 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6be74d2-45fe-4b10-a8be-6364587b604b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:53.427283 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6be74d2-45fe-4b10-a8be-6364587b604b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:53.427753 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6be74d2-45fe-4b10-a8be-6364587b604b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:53.428184 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6be74d2-45fe-4b10-a8be-6364587b604b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:53.507654 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-543d8bf0-f942-4137-842b-11cdbd574ba0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:53.516667 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-543d8bf0-f942-4137-842b-11cdbd574ba0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.356816 Aug 26 06:20:53.530594 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 307/606] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:53 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:53.572681 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-52bdd970-7679-4f21-ba06-db5aa67e01e1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:53.574159 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-52bdd970-7679-4f21-ba06-db5aa67e01e1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:53.584369 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52bdd970-7679-4f21-ba06-db5aa67e01e1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:53.585054 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52bdd970-7679-4f21-ba06-db5aa67e01e1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:53.585603 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52bdd970-7679-4f21-ba06-db5aa67e01e1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:53.586356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52bdd970-7679-4f21-ba06-db5aa67e01e1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:53.586867 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52bdd970-7679-4f21-ba06-db5aa67e01e1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:53.587746 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52bdd970-7679-4f21-ba06-db5aa67e01e1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:53.642991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c6be74d2-45fe-4b10-a8be-6364587b604b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:53.652104 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c6be74d2-45fe-4b10-a8be-6364587b604b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.239019 Aug 26 06:20:53.653018 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 300/607] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:53 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:53.901196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-52bdd970-7679-4f21-ba06-db5aa67e01e1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:53.904047 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f0527be3-6ebe-4820-a890-538106355370 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:53.904690 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f0527be3-6ebe-4820-a890-538106355370 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:53.909169 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=6 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:53.911601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-52bdd970-7679-4f21-ba06-db5aa67e01e1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.345742 Aug 26 06:20:53.917343 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 308/608] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:53 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:53.924523 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0527be3-6ebe-4820-a890-538106355370 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:53.924523 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0527be3-6ebe-4820-a890-538106355370 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:53.924523 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0527be3-6ebe-4820-a890-538106355370 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:53.930372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0527be3-6ebe-4820-a890-538106355370 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:53.930372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0527be3-6ebe-4820-a890-538106355370 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:53.930372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0527be3-6ebe-4820-a890-538106355370 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:54.098480 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f0527be3-6ebe-4820-a890-538106355370 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:54.110288 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f0527be3-6ebe-4820-a890-538106355370 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.210117 Aug 26 06:20:54.111351 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 301/609] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:53 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:54.116484 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:54.117102 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:54.123545 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:54.124131 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:54.124462 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:54.125160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:54.125608 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:54.126031 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:54.279208 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:54.289046 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:54.296875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:54.296875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ee754b2a-494f-43a6-b3e6-aabc24b88c88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1721 microversion: 2.20 time: 0.179673 Aug 26 06:20:54.296875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 309/610] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:54 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:54.542826 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-69b77051-02c2-4a9b-9d4f-7f2710cd0149 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:54.543359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-69b77051-02c2-4a9b-9d4f-7f2710cd0149 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:54.550057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-69b77051-02c2-4a9b-9d4f-7f2710cd0149 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:54.550539 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-69b77051-02c2-4a9b-9d4f-7f2710cd0149 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:54.550993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-69b77051-02c2-4a9b-9d4f-7f2710cd0149 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:54.551856 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-69b77051-02c2-4a9b-9d4f-7f2710cd0149 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:54.552301 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-69b77051-02c2-4a9b-9d4f-7f2710cd0149 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:54.552716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-69b77051-02c2-4a9b-9d4f-7f2710cd0149 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:54.676386 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d4048dcc-e18e-4a42-a32e-636e31ff4d0e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:54.677454 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d4048dcc-e18e-4a42-a32e-636e31ff4d0e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:54.688384 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d4048dcc-e18e-4a42-a32e-636e31ff4d0e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:54.688908 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d4048dcc-e18e-4a42-a32e-636e31ff4d0e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:54.689382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d4048dcc-e18e-4a42-a32e-636e31ff4d0e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:54.690438 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d4048dcc-e18e-4a42-a32e-636e31ff4d0e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:54.691075 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d4048dcc-e18e-4a42-a32e-636e31ff4d0e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:54.691698 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d4048dcc-e18e-4a42-a32e-636e31ff4d0e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:54.709161 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-69b77051-02c2-4a9b-9d4f-7f2710cd0149 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:54.717114 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-69b77051-02c2-4a9b-9d4f-7f2710cd0149 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.178910 Aug 26 06:20:54.717693 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 302/611] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:54 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:54.848179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d4048dcc-e18e-4a42-a32e-636e31ff4d0e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:54.848179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d4048dcc-e18e-4a42-a32e-636e31ff4d0e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.169941 Aug 26 06:20:54.848179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 310/612] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:54 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:54.938157 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-934a5431-2783-416a-a256-1df498ec9f33 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:54.938794 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-934a5431-2783-416a-a256-1df498ec9f33 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:54.945895 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-934a5431-2783-416a-a256-1df498ec9f33 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:54.946377 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-934a5431-2783-416a-a256-1df498ec9f33 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:54.946846 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-934a5431-2783-416a-a256-1df498ec9f33 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:54.947535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-934a5431-2783-416a-a256-1df498ec9f33 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:54.947989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-934a5431-2783-416a-a256-1df498ec9f33 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:54.948415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-934a5431-2783-416a-a256-1df498ec9f33 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:55.090678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-934a5431-2783-416a-a256-1df498ec9f33 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:55.094053 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:55.099194 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-934a5431-2783-416a-a256-1df498ec9f33 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.164802 Aug 26 06:20:55.099880 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 303/613] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:54 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:55.133225 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a4895de0-2d1a-477a-b8da-c0865a12601c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:55.133836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a4895de0-2d1a-477a-b8da-c0865a12601c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:55.139857 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a4895de0-2d1a-477a-b8da-c0865a12601c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:55.140337 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a4895de0-2d1a-477a-b8da-c0865a12601c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:55.140778 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a4895de0-2d1a-477a-b8da-c0865a12601c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:55.141475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a4895de0-2d1a-477a-b8da-c0865a12601c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:55.141927 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a4895de0-2d1a-477a-b8da-c0865a12601c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:55.142351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a4895de0-2d1a-477a-b8da-c0865a12601c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:55.281940 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a4895de0-2d1a-477a-b8da-c0865a12601c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:55.290686 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a4895de0-2d1a-477a-b8da-c0865a12601c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.161609 Aug 26 06:20:55.294662 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 311/614] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:55 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:55.321690 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:55.322380 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:55.328628 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:55.329145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:55.329783 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:55.330716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:55.331180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:55.331636 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:55.399444 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-997cee35-7f41-4882-a5b1-27f6b2057f24 req-7909f0cd-5659-459b-9769-b324c7779494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f739aa85-1e49-4e21-ab74-9463ba8ffd4c", "name": "network-vif-plugged", "status": "completed", "tag": "61f75c3c-a587-4be9-a681-7f29d66f4b4c"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:55.409486 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-997cee35-7f41-4882-a5b1-27f6b2057f24 req-7909f0cd-5659-459b-9769-b324c7779494 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:55.409998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-997cee35-7f41-4882-a5b1-27f6b2057f24 req-7909f0cd-5659-459b-9769-b324c7779494 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:55.410463 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-997cee35-7f41-4882-a5b1-27f6b2057f24 req-7909f0cd-5659-459b-9769-b324c7779494 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:55.422406 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-997cee35-7f41-4882-a5b1-27f6b2057f24 req-7909f0cd-5659-459b-9769-b324c7779494 service nova] Creating event network-vif-plugged:61f75c3c-a587-4be9-a681-7f29d66f4b4c for instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c on hv-cinder-85391 Aug 26 06:20:55.429185 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-997cee35-7f41-4882-a5b1-27f6b2057f24 req-7909f0cd-5659-459b-9769-b324c7779494 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036275 Aug 26 06:20:55.429960 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 312/615] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:20:55.479824 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:55.488405 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:55.489883 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:55.491085 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d5db8595-1f24-4769-918e-bca1f5b04985 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1721 microversion: 2.20 time: 0.175922 Aug 26 06:20:55.491650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 304/616] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:55 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:55.740758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a5ccf76b-61a4-447e-82e5-673682615f6a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:55.741454 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a5ccf76b-61a4-447e-82e5-673682615f6a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:55.748679 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ccf76b-61a4-447e-82e5-673682615f6a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:55.749175 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ccf76b-61a4-447e-82e5-673682615f6a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:55.749612 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ccf76b-61a4-447e-82e5-673682615f6a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:55.753136 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ccf76b-61a4-447e-82e5-673682615f6a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:55.753136 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ccf76b-61a4-447e-82e5-673682615f6a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:55.753136 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a5ccf76b-61a4-447e-82e5-673682615f6a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:55.870756 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d32a205d-8ac1-4602-925d-9c2f4cf8a083 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:55.871372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d32a205d-8ac1-4602-925d-9c2f4cf8a083 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:55.877665 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d32a205d-8ac1-4602-925d-9c2f4cf8a083 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:55.878166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d32a205d-8ac1-4602-925d-9c2f4cf8a083 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:55.878899 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d32a205d-8ac1-4602-925d-9c2f4cf8a083 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:55.880046 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d32a205d-8ac1-4602-925d-9c2f4cf8a083 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:55.880774 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d32a205d-8ac1-4602-925d-9c2f4cf8a083 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:55.881526 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d32a205d-8ac1-4602-925d-9c2f4cf8a083 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:55.964101 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a5ccf76b-61a4-447e-82e5-673682615f6a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:55.973367 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a5ccf76b-61a4-447e-82e5-673682615f6a tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.237164 Aug 26 06:20:55.973972 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 313/617] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:55 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:56.077917 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d32a205d-8ac1-4602-925d-9c2f4cf8a083 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:56.087271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d32a205d-8ac1-4602-925d-9c2f4cf8a083 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.220059 Aug 26 06:20:56.087271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 305/618] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:55 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:56.121401 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-64f648e4-1a00-4fab-a4ca-f9f9ef08785e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:56.122186 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-64f648e4-1a00-4fab-a4ca-f9f9ef08785e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:56.128454 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64f648e4-1a00-4fab-a4ca-f9f9ef08785e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:56.129111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64f648e4-1a00-4fab-a4ca-f9f9ef08785e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:56.129553 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64f648e4-1a00-4fab-a4ca-f9f9ef08785e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:56.130241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64f648e4-1a00-4fab-a4ca-f9f9ef08785e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:56.130728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64f648e4-1a00-4fab-a4ca-f9f9ef08785e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:56.131194 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64f648e4-1a00-4fab-a4ca-f9f9ef08785e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:56.285534 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-64f648e4-1a00-4fab-a4ca-f9f9ef08785e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:56.294864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-64f648e4-1a00-4fab-a4ca-f9f9ef08785e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.177971 Aug 26 06:20:56.295448 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 314/619] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:56 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:56.317334 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-89e5e23e-5009-4c43-ae03-78aac140aabf tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:56.318306 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-89e5e23e-5009-4c43-ae03-78aac140aabf tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:56.324990 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89e5e23e-5009-4c43-ae03-78aac140aabf tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:56.325649 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89e5e23e-5009-4c43-ae03-78aac140aabf tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:56.326176 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89e5e23e-5009-4c43-ae03-78aac140aabf tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:56.326932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89e5e23e-5009-4c43-ae03-78aac140aabf tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:56.327489 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89e5e23e-5009-4c43-ae03-78aac140aabf tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:56.327964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89e5e23e-5009-4c43-ae03-78aac140aabf tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:56.477571 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-89e5e23e-5009-4c43-ae03-78aac140aabf tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:56.485967 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-89e5e23e-5009-4c43-ae03-78aac140aabf tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.173131 Aug 26 06:20:56.486535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 306/620] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:56 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:56.516170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:56.517096 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:56.524970 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:56.525484 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:56.525905 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:56.526589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:56.527064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:56.527488 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:56.676405 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:56.685047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:56.686528 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:56.687717 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a12eb59f-3723-426f-981a-431be1fa4efe tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1721 microversion: 2.20 time: 0.176478 Aug 26 06:20:56.688278 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 315/621] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:56 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:20:57.003157 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0ade91c2-9989-4552-b5d7-082372220d12 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:57.005609 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0ade91c2-9989-4552-b5d7-082372220d12 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:57.012273 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0ade91c2-9989-4552-b5d7-082372220d12 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.012687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0ade91c2-9989-4552-b5d7-082372220d12 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.013118 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0ade91c2-9989-4552-b5d7-082372220d12 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.013803 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0ade91c2-9989-4552-b5d7-082372220d12 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.014284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0ade91c2-9989-4552-b5d7-082372220d12 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.014791 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0ade91c2-9989-4552-b5d7-082372220d12 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.113215 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-58f7aab8-9293-4c7f-8a26-4eb0345b478e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:57.114005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-58f7aab8-9293-4c7f-8a26-4eb0345b478e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:57.120869 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58f7aab8-9293-4c7f-8a26-4eb0345b478e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.121461 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58f7aab8-9293-4c7f-8a26-4eb0345b478e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.121915 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58f7aab8-9293-4c7f-8a26-4eb0345b478e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.122647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58f7aab8-9293-4c7f-8a26-4eb0345b478e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.123100 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58f7aab8-9293-4c7f-8a26-4eb0345b478e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.123699 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58f7aab8-9293-4c7f-8a26-4eb0345b478e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.195418 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0ade91c2-9989-4552-b5d7-082372220d12 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:57.203358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0ade91c2-9989-4552-b5d7-082372220d12 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.204106 Aug 26 06:20:57.204984 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 307/622] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:56 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:57.274177 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-58f7aab8-9293-4c7f-8a26-4eb0345b478e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:57.282428 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-58f7aab8-9293-4c7f-8a26-4eb0345b478e tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.173410 Aug 26 06:20:57.283114 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 316/623] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:57 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:57.320255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3d567bd8-e7cc-4774-9139-41293899d148 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:57.320954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3d567bd8-e7cc-4774-9139-41293899d148 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:57.327205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d567bd8-e7cc-4774-9139-41293899d148 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.327698 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d567bd8-e7cc-4774-9139-41293899d148 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.328144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d567bd8-e7cc-4774-9139-41293899d148 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.328854 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d567bd8-e7cc-4774-9139-41293899d148 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.329316 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d567bd8-e7cc-4774-9139-41293899d148 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.329749 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3d567bd8-e7cc-4774-9139-41293899d148 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.445652 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-51b13038-bd6b-4ed8-af7a-5b60b3c3adcc req-918514ac-c858-47d7-959d-3b970aececbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac54c89b-a0e4-4948-8da6-e9627afd22d4", "name": "network-vif-plugged", "status": "completed", "tag": "8caf9b6b-dcf3-478e-8706-d6a2f2a69cde"}, {"server_uuid": "ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c", "name": "network-vif-unplugged", "status": "completed", "tag": "3b7fc810-cb09-42a2-a246-9a1fd1d7d061"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:57.457046 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-51b13038-bd6b-4ed8-af7a-5b60b3c3adcc req-918514ac-c858-47d7-959d-3b970aececbb service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.457637 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-51b13038-bd6b-4ed8-af7a-5b60b3c3adcc req-918514ac-c858-47d7-959d-3b970aececbb service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.458359 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-51b13038-bd6b-4ed8-af7a-5b60b3c3adcc req-918514ac-c858-47d7-959d-3b970aececbb service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.479455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-51b13038-bd6b-4ed8-af7a-5b60b3c3adcc req-918514ac-c858-47d7-959d-3b970aececbb service nova] Creating event network-vif-plugged:8caf9b6b-dcf3-478e-8706-d6a2f2a69cde for instance ac54c89b-a0e4-4948-8da6-e9627afd22d4 on hv-cinder-85391 Aug 26 06:20:57.481228 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-51b13038-bd6b-4ed8-af7a-5b60b3c3adcc req-918514ac-c858-47d7-959d-3b970aececbb service nova] Creating event network-vif-unplugged:3b7fc810-cb09-42a2-a246-9a1fd1d7d061 for instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c on hv-cinder-85391 Aug 26 06:20:57.483632 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3d567bd8-e7cc-4774-9139-41293899d148 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:57.487550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-51b13038-bd6b-4ed8-af7a-5b60b3c3adcc req-918514ac-c858-47d7-959d-3b970aececbb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.046439 Aug 26 06:20:57.492102 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 317/624] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:20:57.494901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3d567bd8-e7cc-4774-9139-41293899d148 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.178960 Aug 26 06:20:57.495507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 308/625] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:57 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:57.565407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9e097a15-b3ab-4213-a61f-0ba4285b4721 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:57.566166 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9e097a15-b3ab-4213-a61f-0ba4285b4721 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:57.573370 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e097a15-b3ab-4213-a61f-0ba4285b4721 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.573864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e097a15-b3ab-4213-a61f-0ba4285b4721 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.574304 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e097a15-b3ab-4213-a61f-0ba4285b4721 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.575042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e097a15-b3ab-4213-a61f-0ba4285b4721 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.575497 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e097a15-b3ab-4213-a61f-0ba4285b4721 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.575929 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9e097a15-b3ab-4213-a61f-0ba4285b4721 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.714850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:57.716045 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:57.721811 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9e097a15-b3ab-4213-a61f-0ba4285b4721 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:57.724495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.725145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.726263 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.727162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.727686 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.728203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.730512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9e097a15-b3ab-4213-a61f-0ba4285b4721 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.169375 Aug 26 06:20:57.731787 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 318/626] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:57 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:57.882841 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:57.891555 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:57.893276 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:57.894775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9169a8e9-86df-47a3-b05c-acd5b806468b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1724 microversion: 2.20 time: 0.185029 Aug 26 06:20:57.895664 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 309/627] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:20:57 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:20:57.921238 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d6a679ba-8b13-43d8-80bb-4efcee7e9e80 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70061d04-8cee-4a69-8adf-55f2b1a5e1b2"}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:20:57.924835 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d6a679ba-8b13-43d8-80bb-4efcee7e9e80 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:57.932184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6a679ba-8b13-43d8-80bb-4efcee7e9e80 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.932702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6a679ba-8b13-43d8-80bb-4efcee7e9e80 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.933149 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6a679ba-8b13-43d8-80bb-4efcee7e9e80 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:57.933880 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6a679ba-8b13-43d8-80bb-4efcee7e9e80 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:57.934332 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6a679ba-8b13-43d8-80bb-4efcee7e9e80 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:57.934848 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6a679ba-8b13-43d8-80bb-4efcee7e9e80 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:58.227275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-013063c2-2fa9-4887-8ce3-3a237d25b208 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:58.228192 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-013063c2-2fa9-4887-8ce3-3a237d25b208 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:58.235675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-013063c2-2fa9-4887-8ce3-3a237d25b208 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:58.236188 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-013063c2-2fa9-4887-8ce3-3a237d25b208 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:58.236580 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-013063c2-2fa9-4887-8ce3-3a237d25b208 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:58.237655 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-013063c2-2fa9-4887-8ce3-3a237d25b208 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:58.238194 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-013063c2-2fa9-4887-8ce3-3a237d25b208 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:58.239027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-013063c2-2fa9-4887-8ce3-3a237d25b208 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:58.283404 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:20:58.397962 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-013063c2-2fa9-4887-8ce3-3a237d25b208 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:58.406437 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-013063c2-2fa9-4887-8ce3-3a237d25b208 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.184793 Aug 26 06:20:58.407094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 310/628] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:58 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:58.412590 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ff47b00c-9981-4126-aff5-df71e49ba241 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:58.413205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ff47b00c-9981-4126-aff5-df71e49ba241 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:58.420805 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff47b00c-9981-4126-aff5-df71e49ba241 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:58.420805 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff47b00c-9981-4126-aff5-df71e49ba241 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:58.420805 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff47b00c-9981-4126-aff5-df71e49ba241 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:58.422343 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff47b00c-9981-4126-aff5-df71e49ba241 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:58.422343 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff47b00c-9981-4126-aff5-df71e49ba241 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:58.422343 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ff47b00c-9981-4126-aff5-df71e49ba241 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:58.590851 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ff47b00c-9981-4126-aff5-df71e49ba241 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:58.601473 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ff47b00c-9981-4126-aff5-df71e49ba241 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.193303 Aug 26 06:20:58.602054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 311/629] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:58 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:58.607881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2a35ac84-79c5-409c-b791-5df3d7b2bcbf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:58.607881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2a35ac84-79c5-409c-b791-5df3d7b2bcbf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:58.614690 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a35ac84-79c5-409c-b791-5df3d7b2bcbf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:58.617420 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a35ac84-79c5-409c-b791-5df3d7b2bcbf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:58.617420 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a35ac84-79c5-409c-b791-5df3d7b2bcbf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:58.617420 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a35ac84-79c5-409c-b791-5df3d7b2bcbf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:58.617420 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a35ac84-79c5-409c-b791-5df3d7b2bcbf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:58.617926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a35ac84-79c5-409c-b791-5df3d7b2bcbf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:58.785452 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2a35ac84-79c5-409c-b791-5df3d7b2bcbf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:58.795053 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2a35ac84-79c5-409c-b791-5df3d7b2bcbf tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.191905 Aug 26 06:20:58.795707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 312/630] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:58 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:58.800876 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6d11011a-338b-4724-ac4a-ef0ae39d7098 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:58.801499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6d11011a-338b-4724-ac4a-ef0ae39d7098 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:58.808181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6d11011a-338b-4724-ac4a-ef0ae39d7098 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:58.812365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6d11011a-338b-4724-ac4a-ef0ae39d7098 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:58.812365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6d11011a-338b-4724-ac4a-ef0ae39d7098 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:58.812365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6d11011a-338b-4724-ac4a-ef0ae39d7098 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:58.812365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6d11011a-338b-4724-ac4a-ef0ae39d7098 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:58.813012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6d11011a-338b-4724-ac4a-ef0ae39d7098 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:58.959374 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6d11011a-338b-4724-ac4a-ef0ae39d7098 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:58.967710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6d11011a-338b-4724-ac4a-ef0ae39d7098 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1267 microversion: 2.1 time: 0.171005 Aug 26 06:20:58.968298 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 313/631] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:58 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:59.430478 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5ad752e2-640d-4e0c-b167-7eb9b95fd06b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:59.432033 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5ad752e2-640d-4e0c-b167-7eb9b95fd06b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:59.438731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5ad752e2-640d-4e0c-b167-7eb9b95fd06b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:59.446371 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5ad752e2-640d-4e0c-b167-7eb9b95fd06b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:59.448966 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5ad752e2-640d-4e0c-b167-7eb9b95fd06b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:59.449515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5ad752e2-640d-4e0c-b167-7eb9b95fd06b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:59.450451 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5ad752e2-640d-4e0c-b167-7eb9b95fd06b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:59.451578 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5ad752e2-640d-4e0c-b167-7eb9b95fd06b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:59.635864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5ad752e2-640d-4e0c-b167-7eb9b95fd06b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:59.645378 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5ad752e2-640d-4e0c-b167-7eb9b95fd06b tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.218676 Aug 26 06:20:59.646292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 314/632] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:59 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:20:59.651811 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fdd2b925-839a-468b-8262-2cfefd1e6a98 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:59.652426 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fdd2b925-839a-468b-8262-2cfefd1e6a98 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:59.659050 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdd2b925-839a-468b-8262-2cfefd1e6a98 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:59.659693 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdd2b925-839a-468b-8262-2cfefd1e6a98 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:59.660115 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdd2b925-839a-468b-8262-2cfefd1e6a98 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:59.660993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdd2b925-839a-468b-8262-2cfefd1e6a98 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:59.661531 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdd2b925-839a-468b-8262-2cfefd1e6a98 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:59.661799 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fdd2b925-839a-468b-8262-2cfefd1e6a98 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:59.807044 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fdd2b925-839a-468b-8262-2cfefd1e6a98 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:20:59.814754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fdd2b925-839a-468b-8262-2cfefd1e6a98 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.167844 Aug 26 06:20:59.815318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 315/633] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:59 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:20:59.829557 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1f2f4f89-2914-4dd2-ab90-2ed8d0cdc868 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:59.830198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1f2f4f89-2914-4dd2-ab90-2ed8d0cdc868 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:59.839381 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1f2f4f89-2914-4dd2-ab90-2ed8d0cdc868 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:59.839920 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1f2f4f89-2914-4dd2-ab90-2ed8d0cdc868 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:59.840362 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1f2f4f89-2914-4dd2-ab90-2ed8d0cdc868 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:59.841080 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1f2f4f89-2914-4dd2-ab90-2ed8d0cdc868 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:59.841542 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1f2f4f89-2914-4dd2-ab90-2ed8d0cdc868 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:20:59.841981 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1f2f4f89-2914-4dd2-ab90-2ed8d0cdc868 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:20:59.923295 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d6a679ba-8b13-43d8-80bb-4efcee7e9e80 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "POST /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.008469 Aug 26 06:20:59.923915 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 319/634] 10.222.0.40 () {62 vars in 1364 bytes} [Fri Aug 26 06:20:57 2022] POST /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments => generated 188 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:20:59.990224 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b0b3290b-800e-488f-8830-a0ccae8344b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:20:59.990871 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b0b3290b-800e-488f-8830-a0ccae8344b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:20:59.999354 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0b3290b-800e-488f-8830-a0ccae8344b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:20:59.999856 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0b3290b-800e-488f-8830-a0ccae8344b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:00.000618 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0b3290b-800e-488f-8830-a0ccae8344b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:00.001507 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0b3290b-800e-488f-8830-a0ccae8344b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:00.002024 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0b3290b-800e-488f-8830-a0ccae8344b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:00.002660 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0b3290b-800e-488f-8830-a0ccae8344b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:00.011942 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1f2f4f89-2914-4dd2-ab90-2ed8d0cdc868 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:00.022369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1f2f4f89-2914-4dd2-ab90-2ed8d0cdc868 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.196690 Aug 26 06:21:00.023046 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 316/635] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:59 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:00.098077 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a4d7b7df-b454-4d01-b615-82ce5ab8595a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:00.101169 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a4d7b7df-b454-4d01-b615-82ce5ab8595a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:00.105411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4d7b7df-b454-4d01-b615-82ce5ab8595a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:00.105902 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4d7b7df-b454-4d01-b615-82ce5ab8595a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:00.106379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4d7b7df-b454-4d01-b615-82ce5ab8595a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:00.107292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4d7b7df-b454-4d01-b615-82ce5ab8595a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:00.107905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4d7b7df-b454-4d01-b615-82ce5ab8595a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:00.108433 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a4d7b7df-b454-4d01-b615-82ce5ab8595a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:00.168748 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a4d7b7df-b454-4d01-b615-82ce5ab8595a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121344) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 06:21:00.185344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b0b3290b-800e-488f-8830-a0ccae8344b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:00.193626 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b0b3290b-800e-488f-8830-a0ccae8344b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1454 microversion: 2.1 time: 0.207523 Aug 26 06:21:00.194240 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 320/636] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:20:59 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1454 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:00.225900 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6d1e74eb-aa81-4881-8a29-9c39e59e0ae1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:00.226494 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6d1e74eb-aa81-4881-8a29-9c39e59e0ae1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:00.232458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d1e74eb-aa81-4881-8a29-9c39e59e0ae1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:00.232936 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d1e74eb-aa81-4881-8a29-9c39e59e0ae1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:00.233368 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d1e74eb-aa81-4881-8a29-9c39e59e0ae1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:00.234110 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d1e74eb-aa81-4881-8a29-9c39e59e0ae1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:00.234553 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d1e74eb-aa81-4881-8a29-9c39e59e0ae1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:00.234998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6d1e74eb-aa81-4881-8a29-9c39e59e0ae1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:00.399792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6d1e74eb-aa81-4881-8a29-9c39e59e0ae1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:00.410753 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6d1e74eb-aa81-4881-8a29-9c39e59e0ae1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1454 microversion: 2.1 time: 0.188449 Aug 26 06:21:00.411339 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 321/637] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:00 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1454 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:00.699635 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-53b13b5f-7fe8-4baa-9232-13e252c2cb92 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:00.699635 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-53b13b5f-7fe8-4baa-9232-13e252c2cb92 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:00.699635 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53b13b5f-7fe8-4baa-9232-13e252c2cb92 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:00.699635 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53b13b5f-7fe8-4baa-9232-13e252c2cb92 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:00.700492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53b13b5f-7fe8-4baa-9232-13e252c2cb92 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:00.700492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53b13b5f-7fe8-4baa-9232-13e252c2cb92 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:00.700492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53b13b5f-7fe8-4baa-9232-13e252c2cb92 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:00.700492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-53b13b5f-7fe8-4baa-9232-13e252c2cb92 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:00.830854 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-53b13b5f-7fe8-4baa-9232-13e252c2cb92 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:00.904761 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-53b13b5f-7fe8-4baa-9232-13e252c2cb92 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1313 microversion: 2.1 time: 0.164838 Aug 26 06:21:00.904761 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 322/638] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:00 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:00.904761 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e438e5dc-90fe-479a-99cc-ae0ffc8f0b38 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:00.904761 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e438e5dc-90fe-479a-99cc-ae0ffc8f0b38 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:00.904761 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e438e5dc-90fe-479a-99cc-ae0ffc8f0b38 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:00.905173 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e438e5dc-90fe-479a-99cc-ae0ffc8f0b38 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:00.905173 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e438e5dc-90fe-479a-99cc-ae0ffc8f0b38 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:00.905173 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e438e5dc-90fe-479a-99cc-ae0ffc8f0b38 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:00.905173 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e438e5dc-90fe-479a-99cc-ae0ffc8f0b38 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:00.905498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e438e5dc-90fe-479a-99cc-ae0ffc8f0b38 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:01.008784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e438e5dc-90fe-479a-99cc-ae0ffc8f0b38 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:01.016689 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e438e5dc-90fe-479a-99cc-ae0ffc8f0b38 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.175773 Aug 26 06:21:01.017252 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 323/639] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:00 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:01.053603 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-41ec25d0-0a83-4039-9a4c-68fef01e0e31 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:01.054205 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-41ec25d0-0a83-4039-9a4c-68fef01e0e31 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:01.060559 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41ec25d0-0a83-4039-9a4c-68fef01e0e31 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:01.061389 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41ec25d0-0a83-4039-9a4c-68fef01e0e31 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:01.061568 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41ec25d0-0a83-4039-9a4c-68fef01e0e31 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:01.075144 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41ec25d0-0a83-4039-9a4c-68fef01e0e31 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:01.075144 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41ec25d0-0a83-4039-9a4c-68fef01e0e31 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:01.075144 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-41ec25d0-0a83-4039-9a4c-68fef01e0e31 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:01.220227 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a4d7b7df-b454-4d01-b615-82ce5ab8595a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "POST /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/action" status: 202 len: 0 microversion: 2.20 time: 1.126847 Aug 26 06:21:01.228450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 317/640] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 26 06:21:00 2022] POST /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:21:01.238554 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:01.240632 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:01.258862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:01.265266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:01.265266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:01.265266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:01.265266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:01.267698 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:01.290708 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-41ec25d0-0a83-4039-9a4c-68fef01e0e31 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:01.306959 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-41ec25d0-0a83-4039-9a4c-68fef01e0e31 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.257484 Aug 26 06:21:01.316671 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 324/641] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:01 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:01.327844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-1405b7e6-6acd-4c27-9b73-3538bf4babbc req-e86cb313-2420-44e5-b08b-c08146628225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49523656-e2db-453f-a79f-435e6991bacc", "name": "network-vif-plugged", "status": "completed", "tag": "591cc0d6-3149-4691-91d0-6ea7e9e1679f"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:01.343821 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1405b7e6-6acd-4c27-9b73-3538bf4babbc req-e86cb313-2420-44e5-b08b-c08146628225 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:01.344298 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1405b7e6-6acd-4c27-9b73-3538bf4babbc req-e86cb313-2420-44e5-b08b-c08146628225 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:01.344985 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1405b7e6-6acd-4c27-9b73-3538bf4babbc req-e86cb313-2420-44e5-b08b-c08146628225 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:01.358828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-1405b7e6-6acd-4c27-9b73-3538bf4babbc req-e86cb313-2420-44e5-b08b-c08146628225 service nova] Creating event network-vif-plugged:591cc0d6-3149-4691-91d0-6ea7e9e1679f for instance 49523656-e2db-453f-a79f-435e6991bacc on hv-cinder-85391 Aug 26 06:21:01.365425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-1405b7e6-6acd-4c27-9b73-3538bf4babbc req-e86cb313-2420-44e5-b08b-c08146628225 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044381 Aug 26 06:21:01.366932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 325/642] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:21:01.460210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:01.469001 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:01.470438 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:01.471708 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0cff802e-d555-456c-a13f-e1a9675b22f7 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1810 microversion: 2.20 time: 0.241518 Aug 26 06:21:01.473043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 318/643] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:01 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:01.924334 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7bc4bcf7-d0bf-4f23-819f-fb571b7c01fd tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:01.925118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7bc4bcf7-d0bf-4f23-819f-fb571b7c01fd tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:01.932316 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7bc4bcf7-d0bf-4f23-819f-fb571b7c01fd tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:01.932834 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7bc4bcf7-d0bf-4f23-819f-fb571b7c01fd tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:01.933274 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7bc4bcf7-d0bf-4f23-819f-fb571b7c01fd tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:01.934158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7bc4bcf7-d0bf-4f23-819f-fb571b7c01fd tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:01.934752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7bc4bcf7-d0bf-4f23-819f-fb571b7c01fd tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:01.935179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7bc4bcf7-d0bf-4f23-819f-fb571b7c01fd tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:02.039218 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-318e1398-52a0-4928-b9a6-5a5edebd65ad tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:02.041909 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-318e1398-52a0-4928-b9a6-5a5edebd65ad tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:02.046639 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-318e1398-52a0-4928-b9a6-5a5edebd65ad tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:02.047392 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-318e1398-52a0-4928-b9a6-5a5edebd65ad tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:02.047833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-318e1398-52a0-4928-b9a6-5a5edebd65ad tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:02.049012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-318e1398-52a0-4928-b9a6-5a5edebd65ad tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:02.049012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-318e1398-52a0-4928-b9a6-5a5edebd65ad tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:02.051092 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-318e1398-52a0-4928-b9a6-5a5edebd65ad tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:02.219768 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-318e1398-52a0-4928-b9a6-5a5edebd65ad tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:02.238233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-318e1398-52a0-4928-b9a6-5a5edebd65ad tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.198624 Aug 26 06:21:02.238233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 319/644] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:02 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:02.299879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7bc4bcf7-d0bf-4f23-819f-fb571b7c01fd tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:02.299879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7bc4bcf7-d0bf-4f23-819f-fb571b7c01fd tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1497 microversion: 2.1 time: 0.377152 Aug 26 06:21:02.299879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 326/645] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:01 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1497 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:02.349253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9f9dcb45-6a05-46d8-b97f-e90231c084f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:02.350036 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9f9dcb45-6a05-46d8-b97f-e90231c084f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:02.357412 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9f9dcb45-6a05-46d8-b97f-e90231c084f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:02.357898 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9f9dcb45-6a05-46d8-b97f-e90231c084f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:02.358330 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9f9dcb45-6a05-46d8-b97f-e90231c084f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:02.359138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9f9dcb45-6a05-46d8-b97f-e90231c084f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:02.359586 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9f9dcb45-6a05-46d8-b97f-e90231c084f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:02.375013 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9f9dcb45-6a05-46d8-b97f-e90231c084f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:02.500496 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:02.501183 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:02.512041 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:02.512542 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:02.512970 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:02.513904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:02.516697 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:02.517335 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:02.571523 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9f9dcb45-6a05-46d8-b97f-e90231c084f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:02.583989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9f9dcb45-6a05-46d8-b97f-e90231c084f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.249448 Aug 26 06:21:02.583989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 320/646] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:02 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:02.988193 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e5038a41-9659-4c63-b644-e3f2512a8b46 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:02.989385 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e5038a41-9659-4c63-b644-e3f2512a8b46 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:02.999001 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5038a41-9659-4c63-b644-e3f2512a8b46 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:02.999902 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5038a41-9659-4c63-b644-e3f2512a8b46 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:03.000652 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5038a41-9659-4c63-b644-e3f2512a8b46 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:03.001640 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5038a41-9659-4c63-b644-e3f2512a8b46 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:03.002867 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5038a41-9659-4c63-b644-e3f2512a8b46 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:03.004140 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5038a41-9659-4c63-b644-e3f2512a8b46 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:03.017945 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:03.037899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:03.042831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:03.042831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-df08688d-536b-4845-a035-92e751c2ecf6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1750 microversion: 2.20 time: 0.545544 Aug 26 06:21:03.042831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 327/647] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:02 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1750 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:21:03.171938 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e5038a41-9659-4c63-b644-e3f2512a8b46 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:03.181890 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e5038a41-9659-4c63-b644-e3f2512a8b46 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1596 microversion: 2.1 time: 0.201652 Aug 26 06:21:03.182994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 321/648] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:02 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1596 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:03.272000 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-64a2cf27-9790-4a73-b31e-389e497b5b8d tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:03.273176 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-64a2cf27-9790-4a73-b31e-389e497b5b8d tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:03.276315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=100 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:03.285537 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64a2cf27-9790-4a73-b31e-389e497b5b8d tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:03.286334 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64a2cf27-9790-4a73-b31e-389e497b5b8d tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:03.286903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64a2cf27-9790-4a73-b31e-389e497b5b8d tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:03.290788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64a2cf27-9790-4a73-b31e-389e497b5b8d tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:03.290788 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64a2cf27-9790-4a73-b31e-389e497b5b8d tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:03.291033 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64a2cf27-9790-4a73-b31e-389e497b5b8d tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:03.499991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-64a2cf27-9790-4a73-b31e-389e497b5b8d tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:03.509190 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-64a2cf27-9790-4a73-b31e-389e497b5b8d tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1318 microversion: 2.1 time: 0.253207 Aug 26 06:21:03.509769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 328/649] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:03 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:03.606710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8fb38715-2037-4a3b-90aa-1c886b19340a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:03.607674 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8fb38715-2037-4a3b-90aa-1c886b19340a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:03.616387 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8fb38715-2037-4a3b-90aa-1c886b19340a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:03.616884 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8fb38715-2037-4a3b-90aa-1c886b19340a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:03.617352 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8fb38715-2037-4a3b-90aa-1c886b19340a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:03.618093 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8fb38715-2037-4a3b-90aa-1c886b19340a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:03.618549 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8fb38715-2037-4a3b-90aa-1c886b19340a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:03.619018 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8fb38715-2037-4a3b-90aa-1c886b19340a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:03.870765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8fb38715-2037-4a3b-90aa-1c886b19340a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:03.880345 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8fb38715-2037-4a3b-90aa-1c886b19340a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.279837 Aug 26 06:21:03.881266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 322/650] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:03 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:04.024223 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-dac13f21-7178-43b1-87d7-a744a391fc02 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:04.024730 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-dac13f21-7178-43b1-87d7-a744a391fc02 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:04.032639 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dac13f21-7178-43b1-87d7-a744a391fc02 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:04.033164 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dac13f21-7178-43b1-87d7-a744a391fc02 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:04.033872 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dac13f21-7178-43b1-87d7-a744a391fc02 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:04.034771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dac13f21-7178-43b1-87d7-a744a391fc02 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:04.035350 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dac13f21-7178-43b1-87d7-a744a391fc02 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:04.035849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dac13f21-7178-43b1-87d7-a744a391fc02 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:04.069408 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:04.071660 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:04.085540 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-dac13f21-7178-43b1-87d7-a744a391fc02 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Going to try to terminate instance {{(pid=121343) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:21:04.088374 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:04.089238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:04.089879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:04.091921 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:04.092645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:04.093371 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:04.294104 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:04.317054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:04.320022 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:04.322217 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-203cdd6c-8cbd-435c-a5b1-f959bafc4ba2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1750 microversion: 2.20 time: 0.258282 Aug 26 06:21:04.322217 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 323/651] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:04 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1750 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:21:04.531122 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5bb7c0cf-c507-4e54-b675-ed80b33fe772 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:04.531739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5bb7c0cf-c507-4e54-b675-ed80b33fe772 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:04.539778 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5bb7c0cf-c507-4e54-b675-ed80b33fe772 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:04.540620 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5bb7c0cf-c507-4e54-b675-ed80b33fe772 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:04.541268 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5bb7c0cf-c507-4e54-b675-ed80b33fe772 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:04.542304 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5bb7c0cf-c507-4e54-b675-ed80b33fe772 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:04.542726 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5bb7c0cf-c507-4e54-b675-ed80b33fe772 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:04.543158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5bb7c0cf-c507-4e54-b675-ed80b33fe772 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:04.547710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:04.790145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-dac13f21-7178-43b1-87d7-a744a391fc02 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 204 len: 0 microversion: 2.1 time: 0.770959 Aug 26 06:21:04.800564 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 329/652] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:21:04 2022] DELETE /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:21:04.800564 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-81f4a95c-e08b-4f9e-b566-573839c76136 req-4c2741a0-9740-42b0-ac12-4ac6359c7085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f739aa85-1e49-4e21-ab74-9463ba8ffd4c", "tag": "61f75c3c-a587-4be9-a681-7f29d66f4b4c"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:04.816888 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-81f4a95c-e08b-4f9e-b566-573839c76136 req-4c2741a0-9740-42b0-ac12-4ac6359c7085 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:04.817987 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-81f4a95c-e08b-4f9e-b566-573839c76136 req-4c2741a0-9740-42b0-ac12-4ac6359c7085 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:04.818908 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-81f4a95c-e08b-4f9e-b566-573839c76136 req-4c2741a0-9740-42b0-ac12-4ac6359c7085 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:04.835790 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-81f4a95c-e08b-4f9e-b566-573839c76136 req-4c2741a0-9740-42b0-ac12-4ac6359c7085 service nova] Creating event network-changed:61f75c3c-a587-4be9-a681-7f29d66f4b4c for instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c on hv-cinder-85391 Aug 26 06:21:04.841218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-81f4a95c-e08b-4f9e-b566-573839c76136 req-4c2741a0-9740-42b0-ac12-4ac6359c7085 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048557 Aug 26 06:21:04.842356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 330/653] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:21:04.848583 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-65e0e0c0-969e-4ef3-a841-1be7731ae3c5 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:04.849281 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-65e0e0c0-969e-4ef3-a841-1be7731ae3c5 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:04.856948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65e0e0c0-969e-4ef3-a841-1be7731ae3c5 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:04.860422 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65e0e0c0-969e-4ef3-a841-1be7731ae3c5 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:04.860422 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65e0e0c0-969e-4ef3-a841-1be7731ae3c5 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:04.860422 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65e0e0c0-969e-4ef3-a841-1be7731ae3c5 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:04.860422 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65e0e0c0-969e-4ef3-a841-1be7731ae3c5 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:04.861062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-65e0e0c0-969e-4ef3-a841-1be7731ae3c5 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:05.024985 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-65e0e0c0-969e-4ef3-a841-1be7731ae3c5 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:05.033899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-65e0e0c0-969e-4ef3-a841-1be7731ae3c5 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1503 microversion: 2.1 time: 0.190150 Aug 26 06:21:05.034479 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 331/654] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:04 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:05.047494 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-54032f0b-bba1-4e7c-b6dc-98ffbb133a49 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:05.048662 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-54032f0b-bba1-4e7c-b6dc-98ffbb133a49 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:05.056870 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54032f0b-bba1-4e7c-b6dc-98ffbb133a49 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:05.056870 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54032f0b-bba1-4e7c-b6dc-98ffbb133a49 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:05.057932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54032f0b-bba1-4e7c-b6dc-98ffbb133a49 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:05.058701 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54032f0b-bba1-4e7c-b6dc-98ffbb133a49 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:05.059166 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54032f0b-bba1-4e7c-b6dc-98ffbb133a49 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:05.059589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-54032f0b-bba1-4e7c-b6dc-98ffbb133a49 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:05.072867 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5bb7c0cf-c507-4e54-b675-ed80b33fe772 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:05.083347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5bb7c0cf-c507-4e54-b675-ed80b33fe772 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1507 microversion: 2.1 time: 0.555923 Aug 26 06:21:05.083907 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 324/655] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:04 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1507 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:05.117455 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ca4889c3-8c1c-48cc-b7b9-5ee659938571 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "285566c9-3fcf-4191-b462-a5c401ac061c", "device": "/dev/sdb"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:05.125052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ca4889c3-8c1c-48cc-b7b9-5ee659938571 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:05.132863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ca4889c3-8c1c-48cc-b7b9-5ee659938571 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:05.133650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ca4889c3-8c1c-48cc-b7b9-5ee659938571 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:05.134264 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ca4889c3-8c1c-48cc-b7b9-5ee659938571 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:05.135339 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ca4889c3-8c1c-48cc-b7b9-5ee659938571 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:05.136100 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ca4889c3-8c1c-48cc-b7b9-5ee659938571 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:05.136779 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ca4889c3-8c1c-48cc-b7b9-5ee659938571 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:05.301036 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-54032f0b-bba1-4e7c-b6dc-98ffbb133a49 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:05.314451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-54032f0b-bba1-4e7c-b6dc-98ffbb133a49 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.277057 Aug 26 06:21:05.314451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 332/656] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:05 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:05.348133 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:05.355430 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:05.355729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:05.356431 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:05.357123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:05.357887 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:05.358507 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:05.358801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:05.506983 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:05.515860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:05.517307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:05.518465 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d6c07b8e-28de-41af-adb6-9fe97ee4a06b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1752 microversion: 2.20 time: 0.175941 Aug 26 06:21:05.519762 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 333/657] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:05 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:21:06.057673 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4e6f22a4-00a7-420e-98fc-7cb6da977540 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:06.058396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4e6f22a4-00a7-420e-98fc-7cb6da977540 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:06.067633 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e6f22a4-00a7-420e-98fc-7cb6da977540 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:06.068296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e6f22a4-00a7-420e-98fc-7cb6da977540 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:06.068731 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e6f22a4-00a7-420e-98fc-7cb6da977540 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:06.069442 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e6f22a4-00a7-420e-98fc-7cb6da977540 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:06.069888 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e6f22a4-00a7-420e-98fc-7cb6da977540 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:06.070331 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4e6f22a4-00a7-420e-98fc-7cb6da977540 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:06.308530 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4e6f22a4-00a7-420e-98fc-7cb6da977540 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:06.321293 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4e6f22a4-00a7-420e-98fc-7cb6da977540 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1503 microversion: 2.1 time: 0.267611 Aug 26 06:21:06.322368 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 334/658] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:06 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:06.343266 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-fe9c4842-ae9c-4074-858a-e09f3db830d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:06.344110 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-fe9c4842-ae9c-4074-858a-e09f3db830d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:06.352506 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fe9c4842-ae9c-4074-858a-e09f3db830d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:06.353199 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fe9c4842-ae9c-4074-858a-e09f3db830d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:06.353837 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fe9c4842-ae9c-4074-858a-e09f3db830d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:06.354641 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fe9c4842-ae9c-4074-858a-e09f3db830d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:06.355328 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fe9c4842-ae9c-4074-858a-e09f3db830d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:06.355864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fe9c4842-ae9c-4074-858a-e09f3db830d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:06.585566 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fe9c4842-ae9c-4074-858a-e09f3db830d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:06.597454 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-fe9c4842-ae9c-4074-858a-e09f3db830d4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.261373 Aug 26 06:21:06.599818 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 335/659] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:06 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:06.605595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:06.607105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:06.615111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:06.615886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:06.616521 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:06.617514 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:06.618177 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:06.618840 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:07.014478 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:07.029001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:07.030936 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:07.032120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-58d41a44-f62f-4f32-9a03-6f0144a28102 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1752 microversion: 2.20 time: 0.431052 Aug 26 06:21:07.032892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 336/660] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:06 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1752 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:07.219150 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-f641316a-2a19-4abc-b83b-1a2edcc82679 req-f88f2a74-c48f-4371-bc18-6287c7c6a6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff368667-d93b-4b10-9606-09331ebb857c", "tag": "f4d37966-d902-4c07-9ee5-4be2e42d1714"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:07.241055 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f641316a-2a19-4abc-b83b-1a2edcc82679 req-f88f2a74-c48f-4371-bc18-6287c7c6a6b1 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:07.241055 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f641316a-2a19-4abc-b83b-1a2edcc82679 req-f88f2a74-c48f-4371-bc18-6287c7c6a6b1 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:07.241519 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f641316a-2a19-4abc-b83b-1a2edcc82679 req-f88f2a74-c48f-4371-bc18-6287c7c6a6b1 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:07.277351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-f641316a-2a19-4abc-b83b-1a2edcc82679 req-f88f2a74-c48f-4371-bc18-6287c7c6a6b1 service nova] Creating event network-changed:f4d37966-d902-4c07-9ee5-4be2e42d1714 for instance ff368667-d93b-4b10-9606-09331ebb857c on hv-cinder-85391 Aug 26 06:21:07.277351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-f641316a-2a19-4abc-b83b-1a2edcc82679 req-f88f2a74-c48f-4371-bc18-6287c7c6a6b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052792 Aug 26 06:21:07.277351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 337/661] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:21:07.351408 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f8bc4ecb-d67b-4858-8dbd-662ab5099782 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:07.352649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f8bc4ecb-d67b-4858-8dbd-662ab5099782 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:07.359170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8bc4ecb-d67b-4858-8dbd-662ab5099782 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:07.359659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8bc4ecb-d67b-4858-8dbd-662ab5099782 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:07.360093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8bc4ecb-d67b-4858-8dbd-662ab5099782 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:07.360848 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8bc4ecb-d67b-4858-8dbd-662ab5099782 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:07.361307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8bc4ecb-d67b-4858-8dbd-662ab5099782 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:07.361900 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f8bc4ecb-d67b-4858-8dbd-662ab5099782 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:07.587805 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f8bc4ecb-d67b-4858-8dbd-662ab5099782 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:07.598612 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f8bc4ecb-d67b-4858-8dbd-662ab5099782 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1503 microversion: 2.1 time: 0.251510 Aug 26 06:21:07.612865 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 338/662] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:07 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:07.630918 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-50313cf6-093e-41f8-8c74-0f987fa98e9a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:07.631647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-50313cf6-093e-41f8-8c74-0f987fa98e9a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:07.647332 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50313cf6-093e-41f8-8c74-0f987fa98e9a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:07.647332 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50313cf6-093e-41f8-8c74-0f987fa98e9a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:07.647332 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50313cf6-093e-41f8-8c74-0f987fa98e9a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:07.647997 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50313cf6-093e-41f8-8c74-0f987fa98e9a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:07.648691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50313cf6-093e-41f8-8c74-0f987fa98e9a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:07.649405 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50313cf6-093e-41f8-8c74-0f987fa98e9a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:07.710102 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:08.196894 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-50313cf6-093e-41f8-8c74-0f987fa98e9a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:08.211364 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-50313cf6-093e-41f8-8c74-0f987fa98e9a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.586909 Aug 26 06:21:08.217168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 339/663] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:07 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:08.226986 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:08.228213 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:08.244282 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:08.244282 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:08.244282 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:08.244282 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:08.245242 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:08.245242 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:08.467441 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ca4889c3-8c1c-48cc-b7b9-5ee659938571 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "POST /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.353332 Aug 26 06:21:08.475105 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 325/664] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:21:05 2022] POST /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc/os-volume_attachments => generated 194 bytes in 3363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:21:08.482769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:08.491136 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-12b3db77-4d01-4fe4-aa3d-bada54c61c53 req-412e1f79-9266-44c4-863f-030eca658eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac54c89b-a0e4-4948-8da6-e9627afd22d4", "name": "network-vif-deleted", "tag": "8caf9b6b-dcf3-478e-8706-d6a2f2a69cde"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:08.509585 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:08.509900 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-12b3db77-4d01-4fe4-aa3d-bada54c61c53 req-412e1f79-9266-44c4-863f-030eca658eb5 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:08.512714 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-12b3db77-4d01-4fe4-aa3d-bada54c61c53 req-412e1f79-9266-44c4-863f-030eca658eb5 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:08.512714 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-12b3db77-4d01-4fe4-aa3d-bada54c61c53 req-412e1f79-9266-44c4-863f-030eca658eb5 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:08.515443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:08.521137 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bc165f39-c1cc-4df1-9ae8-dcbad55da613 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1752 microversion: 2.20 time: 0.302284 Aug 26 06:21:08.529513 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-12b3db77-4d01-4fe4-aa3d-bada54c61c53 req-412e1f79-9266-44c4-863f-030eca658eb5 service nova] Creating event network-vif-deleted:8caf9b6b-dcf3-478e-8706-d6a2f2a69cde for instance ac54c89b-a0e4-4948-8da6-e9627afd22d4 on hv-cinder-85391 Aug 26 06:21:08.538407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-12b3db77-4d01-4fe4-aa3d-bada54c61c53 req-412e1f79-9266-44c4-863f-030eca658eb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060976 Aug 26 06:21:08.539178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 326/665] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:21:08.540313 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 340/666] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:08 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1752 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:08.621820 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ed43c729-8421-4874-8f3d-d3c3f6154ecc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:08.622532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ed43c729-8421-4874-8f3d-d3c3f6154ecc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:08.629610 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed43c729-8421-4874-8f3d-d3c3f6154ecc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:08.630097 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed43c729-8421-4874-8f3d-d3c3f6154ecc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:08.630546 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed43c729-8421-4874-8f3d-d3c3f6154ecc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:08.631277 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed43c729-8421-4874-8f3d-d3c3f6154ecc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:08.631724 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed43c729-8421-4874-8f3d-d3c3f6154ecc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:08.632144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed43c729-8421-4874-8f3d-d3c3f6154ecc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:08.702198 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ed43c729-8421-4874-8f3d-d3c3f6154ecc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:08.711176 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ed43c729-8421-4874-8f3d-d3c3f6154ecc tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1298 microversion: 2.1 time: 0.093568 Aug 26 06:21:08.711884 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 327/667] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:08 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:09.236710 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7947d27d-49ee-4423-b52c-733466c8164c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:09.237861 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7947d27d-49ee-4423-b52c-733466c8164c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:09.247787 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7947d27d-49ee-4423-b52c-733466c8164c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:09.248501 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7947d27d-49ee-4423-b52c-733466c8164c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:09.249092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7947d27d-49ee-4423-b52c-733466c8164c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:09.250066 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7947d27d-49ee-4423-b52c-733466c8164c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:09.250824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7947d27d-49ee-4423-b52c-733466c8164c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:09.251520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7947d27d-49ee-4423-b52c-733466c8164c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:09.418984 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7947d27d-49ee-4423-b52c-733466c8164c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:09.428829 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7947d27d-49ee-4423-b52c-733466c8164c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.198794 Aug 26 06:21:09.429402 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 341/668] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:09 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:09.560701 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:09.560701 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:09.560701 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:09.560701 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:09.561707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:09.561836 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:09.562261 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:09.562750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:09.733458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:09.737680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:09.741389 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:09.742000 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:09.743019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:09.743936 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:09.744681 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:09.745386 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:09.747868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:09.759108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:09.760552 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:09.761702 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-56d5b2be-8de2-49fe-938b-f2e683d29d8e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.214156 Aug 26 06:21:09.762265 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 328/669] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:09 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:09.781942 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:09.782419 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:09.782875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:09.783317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lazy-loading 'fault' on Instance uuid ac54c89b-a0e4-4948-8da6-e9627afd22d4 {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:21:09.824315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cffd4ac2817448e94d2b32ac7ffcede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38f9319c7534904ac58d1d9f9048b91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:09.832501 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d2994db1-8d4b-4eee-a0f2-632d4a01e647 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 200 len: 1303 microversion: 2.1 time: 0.103177 Aug 26 06:21:09.833620 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 342/670] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:09 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:10.450945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8c720daa-04b3-422d-985b-bd526dd19c86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:10.451552 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8c720daa-04b3-422d-985b-bd526dd19c86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:10.454610 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:10.458701 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c720daa-04b3-422d-985b-bd526dd19c86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:10.459190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c720daa-04b3-422d-985b-bd526dd19c86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:10.459626 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c720daa-04b3-422d-985b-bd526dd19c86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:10.460327 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c720daa-04b3-422d-985b-bd526dd19c86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:10.460779 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c720daa-04b3-422d-985b-bd526dd19c86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:10.461205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c720daa-04b3-422d-985b-bd526dd19c86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:10.594416 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8c720daa-04b3-422d-985b-bd526dd19c86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:10.604024 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8c720daa-04b3-422d-985b-bd526dd19c86 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.156790 Aug 26 06:21:10.604621 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 329/671] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:10 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:10.788819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:10.789646 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:10.796825 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:10.797839 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:10.798273 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:10.799244 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:10.799676 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:10.800098 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:10.856768 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:10.857705 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] [instance: ac54c89b-a0e4-4948-8da6-e9627afd22d4] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:10.868365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:10.868365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:10.868365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:10.868365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:10.868765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:10.868765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:10.888077 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] HTTP exception thrown: Instance ac54c89b-a0e4-4948-8da6-e9627afd22d4 could not be found. Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Request method failure captured: Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 HTTP/1.1 Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGXq2h_4ODG1VcpteGWQxhJ8Pqxs_4jLWCxG13ytQUqbDjKl1cswn-He69NIxvTAxqabNP5FXwZe4XJs0NbecCZajdeKaZDhu-wPwExWtxo7fXslOmFrwpcSCh3oTrGxmfg37K3kScSUOBUam57BLydcjb00HAlvU54d1sKUPkhU9T8 Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: b38f9319c7534904ac58d1d9f9048b91 Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-VolumesActionsTest-1836030690 Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:21:10.889683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b38f9319c7534904ac58d1d9f9048b91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b38f9319c7534904ac58d1d9f9048b91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b38f9319c7534904ac58d1d9f9048b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b38f9319c7534904ac58d1d9f9048b91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-VolumesActionsTest-1836030690 Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: b38f9319c7534904ac58d1d9f9048b91 Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-VolumesActionsTest-1836030690 Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-VolumesActionsTest-1836030690-project Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 2cffd4ac2817448e94d2b32ac7ffcede Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-VolumesActionsTest-1836030690-project Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance ac54c89b-a0e4-4948-8da6-e9627afd22d4 could not be found. Aug 26 06:21:10.891209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'ac54c89b-a0e4-4948-8da6-e9627afd22d4'} Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac54c89b-a0e4-4948-8da6-e9627afd22d4 could not be found. Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:21:10.892108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac54c89b-a0e4-4948-8da6-e9627afd22d4 could not be found. Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac54c89b-a0e4-4948-8da6-e9627afd22d4 could not be found. Aug 26 06:21:10.898871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:10.901341 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] Returning 404 to user: Instance ac54c89b-a0e4-4948-8da6-e9627afd22d4 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:21:10.901341 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c685b0a8-95ca-4dee-9cb0-a1b22abbffa0 tempest-VolumesActionsTest-1836030690 tempest-VolumesActionsTest-1836030690-project] 10.222.0.40 "GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4" status: 404 len: 111 microversion: 2.1 time: 0.041156 Aug 26 06:21:10.901341 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 330/672] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:10 2022] GET /compute/v2.1/servers/ac54c89b-a0e4-4948-8da6-e9627afd22d4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 06:21:11.029385 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:11.041358 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:11.042947 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:11.044123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d1747d1a-befb-4460-86da-f9ce0592a51c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.262191 Aug 26 06:21:11.044679 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 343/673] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:10 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:11.626161 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3e72e5f7-c432-4372-a304-b085342c65aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:11.626796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3e72e5f7-c432-4372-a304-b085342c65aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:11.633966 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3e72e5f7-c432-4372-a304-b085342c65aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:11.634448 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3e72e5f7-c432-4372-a304-b085342c65aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:11.634923 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3e72e5f7-c432-4372-a304-b085342c65aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:11.635654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3e72e5f7-c432-4372-a304-b085342c65aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:11.636109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3e72e5f7-c432-4372-a304-b085342c65aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:11.636537 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3e72e5f7-c432-4372-a304-b085342c65aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:11.778735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3e72e5f7-c432-4372-a304-b085342c65aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:11.787338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3e72e5f7-c432-4372-a304-b085342c65aa tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.165093 Aug 26 06:21:11.787908 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 331/674] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:11 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:12.070711 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:12.071523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:12.078714 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:12.079269 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:12.079920 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:12.080667 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:12.081179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:12.082741 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:12.226146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:12.234583 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:12.236051 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:12.237205 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6f4b78f5-bd2a-40be-a3da-7593ab4dc1ff tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.172612 Aug 26 06:21:12.237899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 344/675] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:12 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:12.810871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c0b4204e-c3fc-43d7-9528-cc4474a80794 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:12.812586 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c0b4204e-c3fc-43d7-9528-cc4474a80794 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:12.821404 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c0b4204e-c3fc-43d7-9528-cc4474a80794 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:12.822532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c0b4204e-c3fc-43d7-9528-cc4474a80794 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:12.823290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c0b4204e-c3fc-43d7-9528-cc4474a80794 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:12.824623 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c0b4204e-c3fc-43d7-9528-cc4474a80794 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:12.825363 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c0b4204e-c3fc-43d7-9528-cc4474a80794 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:12.825833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c0b4204e-c3fc-43d7-9528-cc4474a80794 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:13.068635 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c0b4204e-c3fc-43d7-9528-cc4474a80794 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:13.081526 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c0b4204e-c3fc-43d7-9528-cc4474a80794 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.275564 Aug 26 06:21:13.086086 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 332/676] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:12 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:13.261994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:13.262611 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:13.278916 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:13.280671 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:13.282025 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:13.286214 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:13.287814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:13.288344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:13.511597 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:13.521945 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:13.526460 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:13.528086 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3af1bdac-04f2-4a4a-ba54-621ced880b27 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.270722 Aug 26 06:21:13.528894 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 345/677] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:13 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:21:13.631260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9534c601-7430-4adc-b6fc-7a93093103e1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-948216797"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:13.631810 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9534c601-7430-4adc-b6fc-7a93093103e1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:13.637743 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9534c601-7430-4adc-b6fc-7a93093103e1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:13.645313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9534c601-7430-4adc-b6fc-7a93093103e1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:13.645313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9534c601-7430-4adc-b6fc-7a93093103e1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:13.645313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9534c601-7430-4adc-b6fc-7a93093103e1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:13.645313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9534c601-7430-4adc-b6fc-7a93093103e1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:13.645710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9534c601-7430-4adc-b6fc-7a93093103e1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:13.775477 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.network.security_group_api [None req-9534c601-7430-4adc-b6fc-7a93093103e1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Adding security group 7875ffc9-e6f0-4862-8815-e1c917165a02 to port f4d37966-d902-4c07-9ee5-4be2e42d1714 Aug 26 06:21:14.107388 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e3227962-1046-4bb0-b2eb-203a92f9d348 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:14.108248 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e3227962-1046-4bb0-b2eb-203a92f9d348 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:14.119864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3227962-1046-4bb0-b2eb-203a92f9d348 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:14.120836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3227962-1046-4bb0-b2eb-203a92f9d348 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:14.121590 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3227962-1046-4bb0-b2eb-203a92f9d348 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:14.123876 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3227962-1046-4bb0-b2eb-203a92f9d348 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:14.124655 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3227962-1046-4bb0-b2eb-203a92f9d348 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:14.125507 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e3227962-1046-4bb0-b2eb-203a92f9d348 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:14.364444 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e3227962-1046-4bb0-b2eb-203a92f9d348 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:14.377419 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e3227962-1046-4bb0-b2eb-203a92f9d348 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.273797 Aug 26 06:21:14.388458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 346/678] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:14 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:14.430594 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9534c601-7430-4adc-b6fc-7a93093103e1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "POST /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/action" status: 202 len: 0 microversion: 2.1 time: 0.803856 Aug 26 06:21:14.431542 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 333/679] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:21:13 2022] POST /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/action => generated 0 bytes in 805 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:21:14.446477 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-190c0f55-040b-46a6-85e7-4c15a0f57f47 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:14.448505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-190c0f55-040b-46a6-85e7-4c15a0f57f47 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:14.463141 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190c0f55-040b-46a6-85e7-4c15a0f57f47 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:14.465465 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190c0f55-040b-46a6-85e7-4c15a0f57f47 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:14.466521 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190c0f55-040b-46a6-85e7-4c15a0f57f47 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:14.468908 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190c0f55-040b-46a6-85e7-4c15a0f57f47 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:14.469997 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190c0f55-040b-46a6-85e7-4c15a0f57f47 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:14.471274 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-190c0f55-040b-46a6-85e7-4c15a0f57f47 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:14.513914 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-29e4e206-0fb8-4a44-8681-220017d2715e req-4a0ed0b8-baa4-4caf-9631-d8e595f101c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff368667-d93b-4b10-9606-09331ebb857c", "tag": "f4d37966-d902-4c07-9ee5-4be2e42d1714"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:14.532166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-29e4e206-0fb8-4a44-8681-220017d2715e req-4a0ed0b8-baa4-4caf-9631-d8e595f101c1 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:14.532988 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-29e4e206-0fb8-4a44-8681-220017d2715e req-4a0ed0b8-baa4-4caf-9631-d8e595f101c1 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:14.533678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-29e4e206-0fb8-4a44-8681-220017d2715e req-4a0ed0b8-baa4-4caf-9631-d8e595f101c1 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:14.557841 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-29e4e206-0fb8-4a44-8681-220017d2715e req-4a0ed0b8-baa4-4caf-9631-d8e595f101c1 service nova] Creating event network-changed:f4d37966-d902-4c07-9ee5-4be2e42d1714 for instance ff368667-d93b-4b10-9606-09331ebb857c on hv-cinder-85391 Aug 26 06:21:14.563556 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-29e4e206-0fb8-4a44-8681-220017d2715e req-4a0ed0b8-baa4-4caf-9631-d8e595f101c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055920 Aug 26 06:21:14.569954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 334/680] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:21:14.575939 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:14.576852 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:14.591673 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:14.592406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:14.592994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:14.594138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:14.594776 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:14.595458 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:14.792591 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-190c0f55-040b-46a6-85e7-4c15a0f57f47 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:14.809570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-190c0f55-040b-46a6-85e7-4c15a0f57f47 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1761 microversion: 2.1 time: 0.367073 Aug 26 06:21:14.825177 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 347/681] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:14 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1761 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:14.841834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:14.866158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:14.868002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:14.869463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c7d7ac87-7bdb-4bc9-bb5c-959af82c79a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.297723 Aug 26 06:21:14.870602 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 335/682] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:14 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:15.404213 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b59dfb71-49c4-42a1-8625-736cac42cc84 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:15.404783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b59dfb71-49c4-42a1-8625-736cac42cc84 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:15.411986 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b59dfb71-49c4-42a1-8625-736cac42cc84 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:15.412468 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b59dfb71-49c4-42a1-8625-736cac42cc84 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:15.412904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b59dfb71-49c4-42a1-8625-736cac42cc84 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:15.413630 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b59dfb71-49c4-42a1-8625-736cac42cc84 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:15.414083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b59dfb71-49c4-42a1-8625-736cac42cc84 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:15.414506 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b59dfb71-49c4-42a1-8625-736cac42cc84 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:15.559328 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b59dfb71-49c4-42a1-8625-736cac42cc84 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:15.568293 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b59dfb71-49c4-42a1-8625-736cac42cc84 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.169023 Aug 26 06:21:15.568864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 348/683] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:15 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:15.897789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:15.900145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:15.907450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:15.907960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:15.908402 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:15.909329 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:15.910072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:15.910400 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:16.062013 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:16.073500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:16.075036 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:16.076192 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4ac04dcb-dc71-4b47-92b2-40a045167748 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.182496 Aug 26 06:21:16.091060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 336/684] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:15 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:16.589815 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b5a9efa3-932f-4cd8-8110-09d53530a380 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:16.590379 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b5a9efa3-932f-4cd8-8110-09d53530a380 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:16.597550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b5a9efa3-932f-4cd8-8110-09d53530a380 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:16.598064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b5a9efa3-932f-4cd8-8110-09d53530a380 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:16.598500 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b5a9efa3-932f-4cd8-8110-09d53530a380 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:16.599297 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b5a9efa3-932f-4cd8-8110-09d53530a380 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:16.599716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b5a9efa3-932f-4cd8-8110-09d53530a380 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:16.600145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b5a9efa3-932f-4cd8-8110-09d53530a380 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:16.745575 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b5a9efa3-932f-4cd8-8110-09d53530a380 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:16.755777 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b5a9efa3-932f-4cd8-8110-09d53530a380 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.169926 Aug 26 06:21:16.761876 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 349/685] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:16 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:17.103540 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:17.104224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:17.111743 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:17.112265 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:17.113334 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:17.114446 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:17.114932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:17.115354 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:17.120370 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:17.283982 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:17.296743 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:17.298655 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:17.300704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5debd98e-26a0-4cb6-b230-f5ace4e96b82 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.201370 Aug 26 06:21:17.301335 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 337/686] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:17 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:21:17.778561 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-026c553d-f491-41a7-8018-297a21941705 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:17.779146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-026c553d-f491-41a7-8018-297a21941705 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:17.782737 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:17.786864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-026c553d-f491-41a7-8018-297a21941705 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:17.787385 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-026c553d-f491-41a7-8018-297a21941705 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:17.787786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-026c553d-f491-41a7-8018-297a21941705 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:17.788472 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-026c553d-f491-41a7-8018-297a21941705 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:17.788923 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-026c553d-f491-41a7-8018-297a21941705 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:17.789344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-026c553d-f491-41a7-8018-297a21941705 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:17.933138 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-026c553d-f491-41a7-8018-297a21941705 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:17.942575 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-026c553d-f491-41a7-8018-297a21941705 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.169039 Aug 26 06:21:17.943365 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 350/687] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:17 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:18.331190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:18.332546 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:18.341022 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:18.341622 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:18.342241 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:18.343105 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:18.343565 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:18.344073 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:18.500249 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:18.513616 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:18.515435 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:18.516617 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3f11beea-ef0f-42eb-bfb9-c2d3a0020545 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.189571 Aug 26 06:21:18.517178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 338/688] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:18 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:18.968901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-82aaa5fa-afe3-4132-b479-ec89ca78c4d9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:18.969663 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-82aaa5fa-afe3-4132-b479-ec89ca78c4d9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:18.977840 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82aaa5fa-afe3-4132-b479-ec89ca78c4d9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:18.978333 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82aaa5fa-afe3-4132-b479-ec89ca78c4d9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:18.978953 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82aaa5fa-afe3-4132-b479-ec89ca78c4d9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:18.979653 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82aaa5fa-afe3-4132-b479-ec89ca78c4d9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:18.980118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82aaa5fa-afe3-4132-b479-ec89ca78c4d9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:18.980541 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82aaa5fa-afe3-4132-b479-ec89ca78c4d9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:19.145138 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-82aaa5fa-afe3-4132-b479-ec89ca78c4d9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:19.156062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-82aaa5fa-afe3-4132-b479-ec89ca78c4d9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.191080 Aug 26 06:21:19.156062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 351/689] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:18 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:19.541481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:19.542098 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:19.549345 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:19.550516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:19.550516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:19.551551 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:19.552278 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:19.552708 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:19.747278 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:19.760049 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:19.770365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:19.770365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-06fecba6-55dc-40bf-8d8a-4add6bc6c870 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.226546 Aug 26 06:21:19.770365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 339/690] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:19 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:20.183115 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-82e21501-9197-4054-9262-a5c832d07f87 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:20.184205 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-82e21501-9197-4054-9262-a5c832d07f87 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:20.195752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82e21501-9197-4054-9262-a5c832d07f87 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:20.196914 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82e21501-9197-4054-9262-a5c832d07f87 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:20.197846 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82e21501-9197-4054-9262-a5c832d07f87 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:20.200290 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82e21501-9197-4054-9262-a5c832d07f87 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:20.201300 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82e21501-9197-4054-9262-a5c832d07f87 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:20.202230 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-82e21501-9197-4054-9262-a5c832d07f87 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:20.501542 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-82e21501-9197-4054-9262-a5c832d07f87 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:20.512352 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-82e21501-9197-4054-9262-a5c832d07f87 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.337954 Aug 26 06:21:20.513255 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 352/691] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:20 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:20.792499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:20.793893 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:20.804047 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:20.804919 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:20.805546 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:20.806585 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:20.808317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:20.809264 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:20.980754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:21.004319 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:21.008718 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:21.030875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-29246491-6e45-4ec0-b335-145b667ef801 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.223001 Aug 26 06:21:21.030875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 340/692] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:20 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:21.539254 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-45aa5e2f-a34c-4167-ba16-eb686445120c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:21.540425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-45aa5e2f-a34c-4167-ba16-eb686445120c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:21.548096 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-45aa5e2f-a34c-4167-ba16-eb686445120c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:21.548692 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-45aa5e2f-a34c-4167-ba16-eb686445120c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:21.549391 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-45aa5e2f-a34c-4167-ba16-eb686445120c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:21.550207 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-45aa5e2f-a34c-4167-ba16-eb686445120c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:21.550827 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-45aa5e2f-a34c-4167-ba16-eb686445120c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:21.551326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-45aa5e2f-a34c-4167-ba16-eb686445120c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:21.825174 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-45aa5e2f-a34c-4167-ba16-eb686445120c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:21.836927 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-45aa5e2f-a34c-4167-ba16-eb686445120c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.303406 Aug 26 06:21:21.837814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 353/693] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:21 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:22.051058 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:22.052157 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:22.059559 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:22.060128 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:22.060775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:22.061715 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:22.062296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:22.062909 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:22.231190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:22.242380 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:22.244106 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:22.245494 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-878a0ab9-9465-4b6a-a51e-6e09a3838cec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.199957 Aug 26 06:21:22.250692 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 341/694] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:22 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:22.871082 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-29d86e90-7f9d-4122-ac3e-af597097bc85 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:22.871689 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-29d86e90-7f9d-4122-ac3e-af597097bc85 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:22.894786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29d86e90-7f9d-4122-ac3e-af597097bc85 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:22.896992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29d86e90-7f9d-4122-ac3e-af597097bc85 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:22.897509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29d86e90-7f9d-4122-ac3e-af597097bc85 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:22.901879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29d86e90-7f9d-4122-ac3e-af597097bc85 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:22.902427 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29d86e90-7f9d-4122-ac3e-af597097bc85 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:22.902985 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29d86e90-7f9d-4122-ac3e-af597097bc85 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:23.126513 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-29d86e90-7f9d-4122-ac3e-af597097bc85 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:23.138349 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-29d86e90-7f9d-4122-ac3e-af597097bc85 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.276204 Aug 26 06:21:23.139613 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 354/695] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:22 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:23.270733 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:23.271702 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:23.295230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:23.296196 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:23.299694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:23.299694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:23.299694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:23.300852 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:23.516660 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:23.530611 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:23.532623 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:23.534471 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-958c8bb7-16c4-4af0-bb51-5392ae04ec32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.268822 Aug 26 06:21:23.535266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 342/696] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:23 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:24.164479 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-be39295a-2b42-4c98-bfe1-5bf7751ceb37 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:24.165852 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-be39295a-2b42-4c98-bfe1-5bf7751ceb37 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:24.177203 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be39295a-2b42-4c98-bfe1-5bf7751ceb37 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:24.181633 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be39295a-2b42-4c98-bfe1-5bf7751ceb37 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:24.182486 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be39295a-2b42-4c98-bfe1-5bf7751ceb37 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:24.184230 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be39295a-2b42-4c98-bfe1-5bf7751ceb37 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:24.185058 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be39295a-2b42-4c98-bfe1-5bf7751ceb37 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:24.185713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be39295a-2b42-4c98-bfe1-5bf7751ceb37 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:24.523337 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-be39295a-2b42-4c98-bfe1-5bf7751ceb37 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:24.539513 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-be39295a-2b42-4c98-bfe1-5bf7751ceb37 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.379232 Aug 26 06:21:24.540841 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 355/697] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:24 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:24.559687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:24.561053 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:24.577711 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:24.578255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:24.578938 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:24.583688 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:24.584395 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:24.585067 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:24.854141 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:24.874317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:24.874317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:24.874317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5dfa5b85-c8b7-4302-ab21-4cc7728197ae tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.314670 Aug 26 06:21:24.875054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 343/698] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:24 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:25.621115 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-565466c2-6be6-4f85-944f-895adfa009dd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:25.629778 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-565466c2-6be6-4f85-944f-895adfa009dd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:25.646172 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-565466c2-6be6-4f85-944f-895adfa009dd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:25.646690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-565466c2-6be6-4f85-944f-895adfa009dd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:25.647131 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-565466c2-6be6-4f85-944f-895adfa009dd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:25.647860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-565466c2-6be6-4f85-944f-895adfa009dd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:25.648291 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-565466c2-6be6-4f85-944f-895adfa009dd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:25.648717 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-565466c2-6be6-4f85-944f-895adfa009dd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:25.901265 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:25.902099 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:25.908795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:25.912523 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:25.918997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:25.921196 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:25.921765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:25.922327 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:26.041552 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-565466c2-6be6-4f85-944f-895adfa009dd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:26.060039 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-565466c2-6be6-4f85-944f-895adfa009dd tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.444551 Aug 26 06:21:26.063695 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 356/699] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:25 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:26.233899 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:26.252406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:26.260754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:26.263300 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3238480a-b7dc-41b4-8e7d-98913eba0ed6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.369305 Aug 26 06:21:26.264617 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 344/700] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:25 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:21:27.085111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4dfb93eb-ab95-4f09-b898-b54f8cb61dc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:27.085722 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4dfb93eb-ab95-4f09-b898-b54f8cb61dc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:27.093353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dfb93eb-ab95-4f09-b898-b54f8cb61dc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:27.098651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dfb93eb-ab95-4f09-b898-b54f8cb61dc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:27.098651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dfb93eb-ab95-4f09-b898-b54f8cb61dc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:27.098651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dfb93eb-ab95-4f09-b898-b54f8cb61dc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:27.098651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dfb93eb-ab95-4f09-b898-b54f8cb61dc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:27.099038 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4dfb93eb-ab95-4f09-b898-b54f8cb61dc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:27.243283 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4dfb93eb-ab95-4f09-b898-b54f8cb61dc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:27.251685 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4dfb93eb-ab95-4f09-b898-b54f8cb61dc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.172211 Aug 26 06:21:27.252281 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 357/701] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:27 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:27.292271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:27.293111 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:27.311507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:27.314171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:27.314171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:27.314171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:27.315164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:27.315737 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:27.511788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:27.524864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:27.526808 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:27.528590 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2a681d25-930a-4c90-99ab-6ce098f03f55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.241285 Aug 26 06:21:27.530099 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 345/702] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:27 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:28.275059 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-986a90e3-0a35-4a76-820c-812b842d4180 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:28.275812 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-986a90e3-0a35-4a76-820c-812b842d4180 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:28.288828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-986a90e3-0a35-4a76-820c-812b842d4180 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:28.289327 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-986a90e3-0a35-4a76-820c-812b842d4180 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:28.289765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-986a90e3-0a35-4a76-820c-812b842d4180 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:28.290475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-986a90e3-0a35-4a76-820c-812b842d4180 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:28.290970 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-986a90e3-0a35-4a76-820c-812b842d4180 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:28.291381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-986a90e3-0a35-4a76-820c-812b842d4180 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:28.313792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=100 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:28.479799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-986a90e3-0a35-4a76-820c-812b842d4180 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:28.479799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-986a90e3-0a35-4a76-820c-812b842d4180 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.199667 Aug 26 06:21:28.479799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 358/703] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:28 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:28.555376 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:28.561300 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:28.564496 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:28.565221 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:28.566923 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:28.568161 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:28.568875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:28.569502 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:28.785249 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:28.791415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:28.792998 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:28.794366 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-df132e8b-2084-43f2-9efc-fa3d9d415bde tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.244450 Aug 26 06:21:28.795484 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 346/704] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:28 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:29.498585 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4ee94df8-2db8-4d07-8740-885c53dd4404 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:29.500552 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4ee94df8-2db8-4d07-8740-885c53dd4404 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:29.516416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ee94df8-2db8-4d07-8740-885c53dd4404 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:29.516780 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ee94df8-2db8-4d07-8740-885c53dd4404 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:29.517213 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ee94df8-2db8-4d07-8740-885c53dd4404 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:29.518062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ee94df8-2db8-4d07-8740-885c53dd4404 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:29.519303 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ee94df8-2db8-4d07-8740-885c53dd4404 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:29.520568 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ee94df8-2db8-4d07-8740-885c53dd4404 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:29.744475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4ee94df8-2db8-4d07-8740-885c53dd4404 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:29.755816 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4ee94df8-2db8-4d07-8740-885c53dd4404 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.263861 Aug 26 06:21:29.760633 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 359/705] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:29 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:29.826241 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:29.829508 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:29.841318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:29.842600 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:29.843646 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:29.845092 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:29.846122 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:29.847274 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:30.118322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:30.203922 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:30.206922 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:30.208967 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-72f2b262-f9b5-4f9a-928e-a15a38900ca1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.390198 Aug 26 06:21:30.210418 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 347/706] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:29 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:30.787629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f26213eb-9d48-40be-bd87-ae2dfb71236a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:30.788340 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f26213eb-9d48-40be-bd87-ae2dfb71236a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:30.795995 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26213eb-9d48-40be-bd87-ae2dfb71236a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:30.804286 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26213eb-9d48-40be-bd87-ae2dfb71236a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:30.804286 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26213eb-9d48-40be-bd87-ae2dfb71236a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:30.804286 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26213eb-9d48-40be-bd87-ae2dfb71236a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:30.804286 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26213eb-9d48-40be-bd87-ae2dfb71236a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:30.804733 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f26213eb-9d48-40be-bd87-ae2dfb71236a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:30.949461 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f26213eb-9d48-40be-bd87-ae2dfb71236a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:30.953916 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f26213eb-9d48-40be-bd87-ae2dfb71236a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.171218 Aug 26 06:21:30.954509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 360/707] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:30 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:31.235109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:31.236469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:31.244806 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:31.245445 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:31.246103 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:31.247066 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:31.247727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:31.248258 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:31.426370 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:31.436751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:31.438211 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:31.439515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5fb53801-3006-4571-a40e-49cd4152373a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.208584 Aug 26 06:21:31.440369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 348/708] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:31 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:31.979612 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-55a64904-ce1b-4a51-a829-7a289b579e39 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:31.981016 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-55a64904-ce1b-4a51-a829-7a289b579e39 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:31.989459 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-55a64904-ce1b-4a51-a829-7a289b579e39 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:31.990104 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-55a64904-ce1b-4a51-a829-7a289b579e39 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:31.990702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-55a64904-ce1b-4a51-a829-7a289b579e39 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:31.991753 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-55a64904-ce1b-4a51-a829-7a289b579e39 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:31.992477 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-55a64904-ce1b-4a51-a829-7a289b579e39 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:31.993224 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-55a64904-ce1b-4a51-a829-7a289b579e39 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:32.185018 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-55a64904-ce1b-4a51-a829-7a289b579e39 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:32.200152 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-55a64904-ce1b-4a51-a829-7a289b579e39 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.225221 Aug 26 06:21:32.218348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 361/709] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:31 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:32.510167 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:32.511872 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:32.533923 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:32.536037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:32.537222 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:32.538762 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:32.540259 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:32.541027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:32.778279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:32.794471 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:32.796992 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:32.799401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-350f9c43-9d1b-4724-969d-d2828e6ca1cd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.307750 Aug 26 06:21:32.800463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 349/710] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:32 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:33.227965 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-832589c9-2074-4066-a511-d41d15fdfeb9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:33.229042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-832589c9-2074-4066-a511-d41d15fdfeb9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:33.236816 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-832589c9-2074-4066-a511-d41d15fdfeb9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:33.238178 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-832589c9-2074-4066-a511-d41d15fdfeb9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:33.238740 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-832589c9-2074-4066-a511-d41d15fdfeb9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:33.240009 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-832589c9-2074-4066-a511-d41d15fdfeb9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:33.240321 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-832589c9-2074-4066-a511-d41d15fdfeb9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:33.240643 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-832589c9-2074-4066-a511-d41d15fdfeb9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:33.510192 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-832589c9-2074-4066-a511-d41d15fdfeb9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:33.525178 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-832589c9-2074-4066-a511-d41d15fdfeb9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.301458 Aug 26 06:21:33.526203 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 362/711] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:33 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:33.835487 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:33.836750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:33.849564 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:33.850225 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:33.850843 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:33.851868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:33.852378 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:33.853123 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:34.080849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:34.094671 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:34.095857 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:34.097994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-75e02d28-874f-4e6d-88eb-617657984144 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.272627 Aug 26 06:21:34.099160 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 350/712] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:33 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:34.548893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-1379a80b-ddf2-4a49-8fd3-f92c5608fb50 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:34.549749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1379a80b-ddf2-4a49-8fd3-f92c5608fb50 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:34.557000 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1379a80b-ddf2-4a49-8fd3-f92c5608fb50 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:34.557491 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1379a80b-ddf2-4a49-8fd3-f92c5608fb50 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:34.557925 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1379a80b-ddf2-4a49-8fd3-f92c5608fb50 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:34.558643 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1379a80b-ddf2-4a49-8fd3-f92c5608fb50 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:34.559191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1379a80b-ddf2-4a49-8fd3-f92c5608fb50 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:34.559555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1379a80b-ddf2-4a49-8fd3-f92c5608fb50 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:34.766174 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1379a80b-ddf2-4a49-8fd3-f92c5608fb50 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:34.776509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-1379a80b-ddf2-4a49-8fd3-f92c5608fb50 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.231826 Aug 26 06:21:34.777928 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 363/713] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:34 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:35.129718 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:35.130907 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:35.156674 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:35.157787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:35.158827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:35.160775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:35.161641 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:35.162081 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:35.353055 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:35.376945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:35.380435 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:35.382736 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9b4dc670-db00-42ac-80ef-bcfd17a77ada tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.262108 Aug 26 06:21:35.386661 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 351/714] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:35 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:35.801473 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-50fc1d65-3b14-4560-98be-54da11479ee8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:35.802765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-50fc1d65-3b14-4560-98be-54da11479ee8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:35.809931 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50fc1d65-3b14-4560-98be-54da11479ee8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:35.810742 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50fc1d65-3b14-4560-98be-54da11479ee8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:35.811354 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50fc1d65-3b14-4560-98be-54da11479ee8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:35.812263 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50fc1d65-3b14-4560-98be-54da11479ee8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:35.812704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50fc1d65-3b14-4560-98be-54da11479ee8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:35.813568 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50fc1d65-3b14-4560-98be-54da11479ee8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:36.017334 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-50fc1d65-3b14-4560-98be-54da11479ee8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:36.028269 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-50fc1d65-3b14-4560-98be-54da11479ee8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1734 microversion: 2.1 time: 0.231823 Aug 26 06:21:36.029165 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 364/715] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:35 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:36.409541 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:36.420690 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:36.425312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:36.425877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:36.426314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:36.427115 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:36.427796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:36.428394 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:36.654203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:36.664611 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:36.666132 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:36.667930 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c51bbd11-35f2-4f23-a3de-94e9a0c521e9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.263567 Aug 26 06:21:36.669613 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 352/716] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:36 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:37.052191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6a1fa92a-b819-4220-814c-01744047acc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:37.053959 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6a1fa92a-b819-4220-814c-01744047acc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:37.058433 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:37.063053 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6a1fa92a-b819-4220-814c-01744047acc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:37.063570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6a1fa92a-b819-4220-814c-01744047acc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:37.064130 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6a1fa92a-b819-4220-814c-01744047acc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:37.065196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6a1fa92a-b819-4220-814c-01744047acc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:37.066590 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6a1fa92a-b819-4220-814c-01744047acc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:37.067417 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6a1fa92a-b819-4220-814c-01744047acc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:37.273126 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6a1fa92a-b819-4220-814c-01744047acc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:37.286923 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6a1fa92a-b819-4220-814c-01744047acc4 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1714 microversion: 2.1 time: 0.240931 Aug 26 06:21:37.294473 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 365/717] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:37 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1714 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:37.479716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:37.481954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:37.493415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:37.494646 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:37.495704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:37.497182 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:37.497881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:37.498944 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:37.642576 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:37.649538 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] HTTP exception thrown: Cannot 'detach_volume' instance 45330505-4b58-4762-bb9f-e704f9648e1e while it is in vm_state rescued Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Request method failure captured: Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: DELETE /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments/1ea527f3-b73c-471a-8c87-dce4881165cd HTTP/1.1 Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGVFBJkPt1N_LAygoJk3npVpvTaiY6oESY7H7eIhb_pE7vIfLRLef0yZ0WO-eOYSAOu29g7tC4almRLKeCmwL68LeS-3Lt-Rocdb4_uhlsXGoOdyOmAFICyobY7aGtCo9lib4xItQIjA7QHpX69KFGmPiDgQ7mjKlhTYlPfqbJSO7CA Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: 84a2eee4447b4eadb79fbdbb874d4476 Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:21:37.653172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:21:37.655763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:21:37.655763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:21:37.655763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: 84a2eee4447b4eadb79fbdbb874d4476 Aug 26 06:21:37.655763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:21:37.655763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-ServerRescueNegativeTestJSON-952056989-project Aug 26 06:21:37.655763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:21:37.655763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:21:37.655763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 8d154e96376a49918658b0c340c722e9 Aug 26 06:21:37.655763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-ServerRescueNegativeTestJSON-952056989-project Aug 26 06:21:37.655763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:21:37.655763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Cannot 'detach_volume' instance 45330505-4b58-4762-bb9f-e704f9648e1e while it is in vm_state rescued Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'server_id': '45330505-4b58-4762-bb9f-e704f9648e1e', 'id': '1ea527f3-b73c-471a-8c87-dce4881165cd'} Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45330505-4b58-4762-bb9f-e704f9648e1e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:21:37.657209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 45330505-4b58-4762-bb9f-e704f9648e1e while it is in vm_state rescued Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 45330505-4b58-4762-bb9f-e704f9648e1e while it is in vm_state rescued Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:37.669228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Returning 409 to user: Cannot 'detach_volume' instance 45330505-4b58-4762-bb9f-e704f9648e1e while it is in vm_state rescued {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:21:37.671012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d834d701-7de0-4699-ab3e-38b4591a81b8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "DELETE /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments/1ea527f3-b73c-471a-8c87-dce4881165cd" status: 409 len: 152 microversion: 2.1 time: 0.190439 Aug 26 06:21:37.671012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 353/718] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:21:37 2022] DELETE /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments/1ea527f3-b73c-471a-8c87-dce4881165cd => generated 152 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 06:21:37.676782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d5e2c166-2acc-4a0a-9446-69f4e7bc9337 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:37.678689 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d5e2c166-2acc-4a0a-9446-69f4e7bc9337 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:37.689452 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d5e2c166-2acc-4a0a-9446-69f4e7bc9337 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:37.690765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d5e2c166-2acc-4a0a-9446-69f4e7bc9337 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:37.691735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d5e2c166-2acc-4a0a-9446-69f4e7bc9337 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:37.693324 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d5e2c166-2acc-4a0a-9446-69f4e7bc9337 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:37.694518 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d5e2c166-2acc-4a0a-9446-69f4e7bc9337 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:37.695258 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d5e2c166-2acc-4a0a-9446-69f4e7bc9337 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:37.713483 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:37.715243 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:37.728179 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:37.728179 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:37.728179 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:37.728179 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:37.728639 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:37.728639 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:37.954472 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:37.982871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:37.982871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:37.984962 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2c8e5aa4-bb96-4ec5-bad7-822deddb1fca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.275150 Aug 26 06:21:37.984962 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 354/719] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:37 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:38.066523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d5e2c166-2acc-4a0a-9446-69f4e7bc9337 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "POST /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.396163 Aug 26 06:21:38.067766 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 366/720] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:21:37 2022] POST /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:21:38.160450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7ac140e2-8946-46dc-8df1-976b5e976781 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:38.169212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7ac140e2-8946-46dc-8df1-976b5e976781 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:38.169212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ac140e2-8946-46dc-8df1-976b5e976781 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:38.169212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ac140e2-8946-46dc-8df1-976b5e976781 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:38.169212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ac140e2-8946-46dc-8df1-976b5e976781 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:38.169590 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ac140e2-8946-46dc-8df1-976b5e976781 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:38.169788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ac140e2-8946-46dc-8df1-976b5e976781 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:38.170275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ac140e2-8946-46dc-8df1-976b5e976781 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:38.323589 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7ac140e2-8946-46dc-8df1-976b5e976781 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:38.333577 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7ac140e2-8946-46dc-8df1-976b5e976781 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1722 microversion: 2.1 time: 0.257095 Aug 26 06:21:38.334340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 355/721] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:38 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:39.016879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:39.017814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:39.026386 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:39.027188 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:39.027958 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:39.028871 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:39.030180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:39.030891 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:39.245653 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:39.255533 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:39.257027 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:39.258187 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c66533de-0841-4b7d-85d2-883a8d759fd8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.248994 Aug 26 06:21:39.258772 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 367/722] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:39 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:39.365224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-bc8323d0-1d6c-4d5f-8bfe-12d024413af8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:39.365224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-bc8323d0-1d6c-4d5f-8bfe-12d024413af8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:39.366683 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc8323d0-1d6c-4d5f-8bfe-12d024413af8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:39.367180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc8323d0-1d6c-4d5f-8bfe-12d024413af8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:39.367619 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc8323d0-1d6c-4d5f-8bfe-12d024413af8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:39.368443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc8323d0-1d6c-4d5f-8bfe-12d024413af8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:39.368937 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc8323d0-1d6c-4d5f-8bfe-12d024413af8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:39.369359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc8323d0-1d6c-4d5f-8bfe-12d024413af8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:39.517558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-bc8323d0-1d6c-4d5f-8bfe-12d024413af8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:39.527744 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-bc8323d0-1d6c-4d5f-8bfe-12d024413af8 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1722 microversion: 2.1 time: 0.174705 Aug 26 06:21:39.528313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 356/723] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:39 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:40.245842 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-34463465-d52e-4599-9c8d-a6e3aaa26bae tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:40.248212 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-34463465-d52e-4599-9c8d-a6e3aaa26bae tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:40.255957 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-34463465-d52e-4599-9c8d-a6e3aaa26bae tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:40.256439 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-34463465-d52e-4599-9c8d-a6e3aaa26bae tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:40.256877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-34463465-d52e-4599-9c8d-a6e3aaa26bae tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:40.257648 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-34463465-d52e-4599-9c8d-a6e3aaa26bae tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:40.258160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-34463465-d52e-4599-9c8d-a6e3aaa26bae tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:40.258590 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-34463465-d52e-4599-9c8d-a6e3aaa26bae tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:40.281654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:40.282854 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:40.290350 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:40.291207 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:40.291969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:40.293535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:40.293535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:40.293982 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:40.300644 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-34463465-d52e-4599-9c8d-a6e3aaa26bae tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056935 Aug 26 06:21:40.301244 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 368/724] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:21:40 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 06:21:40.385203 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f474bcde-09bd-46b3-b5f8-3e69ac87bb5d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:40.386558 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f474bcde-09bd-46b3-b5f8-3e69ac87bb5d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:40.393520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f474bcde-09bd-46b3-b5f8-3e69ac87bb5d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:40.394012 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f474bcde-09bd-46b3-b5f8-3e69ac87bb5d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:40.394652 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f474bcde-09bd-46b3-b5f8-3e69ac87bb5d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:40.395536 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f474bcde-09bd-46b3-b5f8-3e69ac87bb5d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:40.395996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f474bcde-09bd-46b3-b5f8-3e69ac87bb5d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:40.404718 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f474bcde-09bd-46b3-b5f8-3e69ac87bb5d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:40.423132 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f474bcde-09bd-46b3-b5f8-3e69ac87bb5d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Going to try to terminate instance {{(pid=121343) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:21:40.485756 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:40.497926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:40.499495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:40.500783 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-34b7c982-004f-4695-ab82-7cc084c5bf74 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.223236 Aug 26 06:21:40.501353 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 357/725] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:40 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:21:40.551167 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6e04da51-742a-4f9c-9cfc-8ca94b5d67af tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:40.559275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6e04da51-742a-4f9c-9cfc-8ca94b5d67af tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:40.559275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e04da51-742a-4f9c-9cfc-8ca94b5d67af tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:40.559275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e04da51-742a-4f9c-9cfc-8ca94b5d67af tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:40.559275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e04da51-742a-4f9c-9cfc-8ca94b5d67af tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:40.560809 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e04da51-742a-4f9c-9cfc-8ca94b5d67af tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:40.561270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e04da51-742a-4f9c-9cfc-8ca94b5d67af tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:40.561707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e04da51-742a-4f9c-9cfc-8ca94b5d67af tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:40.709548 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6e04da51-742a-4f9c-9cfc-8ca94b5d67af tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:40.718402 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6e04da51-742a-4f9c-9cfc-8ca94b5d67af tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1722 microversion: 2.1 time: 0.171703 Aug 26 06:21:40.719005 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 358/726] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:40 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:41.009328 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f474bcde-09bd-46b3-b5f8-3e69ac87bb5d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 204 len: 0 microversion: 2.1 time: 0.627666 Aug 26 06:21:41.010818 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 369/727] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:21:40 2022] DELETE /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:21:41.023596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4ba8e526-38e3-465c-bec6-1a92c19d7401 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:41.024372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4ba8e526-38e3-465c-bec6-1a92c19d7401 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:41.036244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ba8e526-38e3-465c-bec6-1a92c19d7401 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:41.036244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ba8e526-38e3-465c-bec6-1a92c19d7401 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:41.036244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ba8e526-38e3-465c-bec6-1a92c19d7401 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:41.036244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ba8e526-38e3-465c-bec6-1a92c19d7401 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:41.036824 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ba8e526-38e3-465c-bec6-1a92c19d7401 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:41.036824 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ba8e526-38e3-465c-bec6-1a92c19d7401 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:41.183399 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4ba8e526-38e3-465c-bec6-1a92c19d7401 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:41.193051 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4ba8e526-38e3-465c-bec6-1a92c19d7401 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1672 microversion: 2.1 time: 0.177005 Aug 26 06:21:41.193640 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 359/728] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:41 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:41.528342 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:41.529154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:41.537717 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:41.538281 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:41.538933 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:41.539895 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:41.540323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:41.540786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:41.704460 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-87932a75-b74f-4f72-99e0-54e40b508f7f req-7af2a5b5-db38-4f52-9725-e80ce5db634e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c", "name": "network-vif-plugged", "status": "completed", "tag": "3b7fc810-cb09-42a2-a246-9a1fd1d7d061"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:41.713487 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:41.725327 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:41.727118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:41.728591 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f9eb175b-0f45-4c07-86c4-a345131a8ffd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.206042 Aug 26 06:21:41.729361 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-87932a75-b74f-4f72-99e0-54e40b508f7f req-7af2a5b5-db38-4f52-9725-e80ce5db634e service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:41.729508 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 370/729] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:41 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:41.730589 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-87932a75-b74f-4f72-99e0-54e40b508f7f req-7af2a5b5-db38-4f52-9725-e80ce5db634e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:41.730589 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-87932a75-b74f-4f72-99e0-54e40b508f7f req-7af2a5b5-db38-4f52-9725-e80ce5db634e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:41.743441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-44b0ebb4-15de-491a-abd3-ca0780bb684f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:41.744843 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-44b0ebb4-15de-491a-abd3-ca0780bb684f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:41.761701 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44b0ebb4-15de-491a-abd3-ca0780bb684f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:41.761701 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44b0ebb4-15de-491a-abd3-ca0780bb684f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:41.761701 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44b0ebb4-15de-491a-abd3-ca0780bb684f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:41.761701 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44b0ebb4-15de-491a-abd3-ca0780bb684f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:41.762382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44b0ebb4-15de-491a-abd3-ca0780bb684f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:41.762382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-44b0ebb4-15de-491a-abd3-ca0780bb684f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:41.762573 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-87932a75-b74f-4f72-99e0-54e40b508f7f req-7af2a5b5-db38-4f52-9725-e80ce5db634e service nova] Creating event network-vif-plugged:3b7fc810-cb09-42a2-a246-9a1fd1d7d061 for instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c on hv-cinder-85391 Aug 26 06:21:41.776506 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-87932a75-b74f-4f72-99e0-54e40b508f7f req-7af2a5b5-db38-4f52-9725-e80ce5db634e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080607 Aug 26 06:21:41.777195 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 360/730] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:21:41.923658 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-44b0ebb4-15de-491a-abd3-ca0780bb684f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:41.934441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-44b0ebb4-15de-491a-abd3-ca0780bb684f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1722 microversion: 2.1 time: 0.196973 Aug 26 06:21:41.935068 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 371/731] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:41 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:42.216169 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7701ad0d-4644-4c2a-b9f0-100a18b42413 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:42.216857 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7701ad0d-4644-4c2a-b9f0-100a18b42413 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:42.224618 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7701ad0d-4644-4c2a-b9f0-100a18b42413 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:42.225147 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7701ad0d-4644-4c2a-b9f0-100a18b42413 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:42.225809 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7701ad0d-4644-4c2a-b9f0-100a18b42413 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:42.226540 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7701ad0d-4644-4c2a-b9f0-100a18b42413 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:42.227019 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7701ad0d-4644-4c2a-b9f0-100a18b42413 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:42.227446 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7701ad0d-4644-4c2a-b9f0-100a18b42413 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:42.373752 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7701ad0d-4644-4c2a-b9f0-100a18b42413 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:42.382507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7701ad0d-4644-4c2a-b9f0-100a18b42413 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1672 microversion: 2.1 time: 0.170789 Aug 26 06:21:42.383468 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 361/732] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:42 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:42.753518 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:42.754428 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:42.761512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:42.762038 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:42.762473 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:42.763206 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:42.763652 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:42.764066 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:42.781842 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:42.927196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:42.936674 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:42.938111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:42.939343 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ba21fbba-5112-4357-83f1-ae213da7240b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.190408 Aug 26 06:21:42.939914 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 372/733] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:42 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:42.977769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f7da6fd2-b770-4ded-a0c9-5cf072a6555b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:42.977769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f7da6fd2-b770-4ded-a0c9-5cf072a6555b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:42.977769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7da6fd2-b770-4ded-a0c9-5cf072a6555b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:42.977769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7da6fd2-b770-4ded-a0c9-5cf072a6555b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:42.978429 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7da6fd2-b770-4ded-a0c9-5cf072a6555b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:42.978429 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7da6fd2-b770-4ded-a0c9-5cf072a6555b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:42.978429 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7da6fd2-b770-4ded-a0c9-5cf072a6555b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:42.978429 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7da6fd2-b770-4ded-a0c9-5cf072a6555b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:43.116239 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f7da6fd2-b770-4ded-a0c9-5cf072a6555b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:43.125480 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f7da6fd2-b770-4ded-a0c9-5cf072a6555b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1722 microversion: 2.1 time: 0.169822 Aug 26 06:21:43.125994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 362/734] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:42 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:43.408331 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6f389e8a-6254-41fd-9508-cc1c6d2d9e13 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:43.409765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6f389e8a-6254-41fd-9508-cc1c6d2d9e13 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:43.416152 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f389e8a-6254-41fd-9508-cc1c6d2d9e13 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:43.416628 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f389e8a-6254-41fd-9508-cc1c6d2d9e13 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:43.417061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f389e8a-6254-41fd-9508-cc1c6d2d9e13 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:43.417765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f389e8a-6254-41fd-9508-cc1c6d2d9e13 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:43.418196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f389e8a-6254-41fd-9508-cc1c6d2d9e13 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:43.418680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f389e8a-6254-41fd-9508-cc1c6d2d9e13 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:43.557706 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6f389e8a-6254-41fd-9508-cc1c6d2d9e13 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:43.566559 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6f389e8a-6254-41fd-9508-cc1c6d2d9e13 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1672 microversion: 2.1 time: 0.161532 Aug 26 06:21:43.567189 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 373/735] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:43 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:43.966090 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:43.966736 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:43.974390 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:43.975217 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:43.976668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:43.976668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:43.976668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:43.976975 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:44.116564 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:44.126155 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:44.127628 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:44.128798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3fce87ba-22b1-463a-b555-0f11eb1b5489 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.166807 Aug 26 06:21:44.129357 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 363/736] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:43 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:44.148255 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8951a3b8-5771-4122-a9e7-e406ba7a32e9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:44.148829 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8951a3b8-5771-4122-a9e7-e406ba7a32e9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:44.155356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8951a3b8-5771-4122-a9e7-e406ba7a32e9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:44.155860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8951a3b8-5771-4122-a9e7-e406ba7a32e9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:44.156278 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8951a3b8-5771-4122-a9e7-e406ba7a32e9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:44.156974 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8951a3b8-5771-4122-a9e7-e406ba7a32e9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:44.157425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8951a3b8-5771-4122-a9e7-e406ba7a32e9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:44.157848 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8951a3b8-5771-4122-a9e7-e406ba7a32e9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:44.325404 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8951a3b8-5771-4122-a9e7-e406ba7a32e9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:44.335096 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8951a3b8-5771-4122-a9e7-e406ba7a32e9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1722 microversion: 2.1 time: 0.191370 Aug 26 06:21:44.335676 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 374/737] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:44 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:44.588449 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2a50bb5d-e048-47bd-890f-6c2ee2e8889e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:44.589244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2a50bb5d-e048-47bd-890f-6c2ee2e8889e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:44.595385 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a50bb5d-e048-47bd-890f-6c2ee2e8889e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:44.596079 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a50bb5d-e048-47bd-890f-6c2ee2e8889e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:44.596353 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a50bb5d-e048-47bd-890f-6c2ee2e8889e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:44.597049 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a50bb5d-e048-47bd-890f-6c2ee2e8889e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:44.597508 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a50bb5d-e048-47bd-890f-6c2ee2e8889e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:44.597929 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a50bb5d-e048-47bd-890f-6c2ee2e8889e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:44.665325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-af772fc9-19b3-42b5-aafd-9acda20ab28c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:44.665819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-af772fc9-19b3-42b5-aafd-9acda20ab28c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:44.672075 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-af772fc9-19b3-42b5-aafd-9acda20ab28c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:44.672557 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-af772fc9-19b3-42b5-aafd-9acda20ab28c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:44.673256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-af772fc9-19b3-42b5-aafd-9acda20ab28c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:44.673959 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-af772fc9-19b3-42b5-aafd-9acda20ab28c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:44.674447 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-af772fc9-19b3-42b5-aafd-9acda20ab28c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:44.675563 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-af772fc9-19b3-42b5-aafd-9acda20ab28c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:44.742073 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2a50bb5d-e048-47bd-890f-6c2ee2e8889e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:44.751565 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2a50bb5d-e048-47bd-890f-6c2ee2e8889e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1672 microversion: 2.1 time: 0.167040 Aug 26 06:21:44.758856 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 364/738] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:44 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:44.772001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-af772fc9-19b3-42b5-aafd-9acda20ab28c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lazy-loading 'services' on Instance uuid 49523656-e2db-453f-a79f-435e6991bacc {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:21:45.155505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:45.155505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:45.162873 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:45.163770 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:45.164487 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:45.165540 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:45.166268 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:45.166854 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:45.227584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-af772fc9-19b3-42b5-aafd-9acda20ab28c tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "DELETE /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc/os-volume_attachments/285566c9-3fcf-4191-b462-a5c401ac061c" status: 202 len: 0 microversion: 2.1 time: 0.565926 Aug 26 06:21:45.228186 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 375/739] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:21:44 2022] DELETE /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc/os-volume_attachments/285566c9-3fcf-4191-b462-a5c401ac061c => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 06:21:45.343565 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:45.357096 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a35d63a3-3f75-4fb0-89df-e85125ede049 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:45.357953 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a35d63a3-3f75-4fb0-89df-e85125ede049 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:45.358537 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:45.361142 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:45.363776 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7812d36d-d8cb-4fea-9681-60fa7a0b8fc6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.214035 Aug 26 06:21:45.364738 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 365/740] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:45 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:21:45.366110 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a35d63a3-3f75-4fb0-89df-e85125ede049 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:45.366754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a35d63a3-3f75-4fb0-89df-e85125ede049 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:45.367296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a35d63a3-3f75-4fb0-89df-e85125ede049 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:45.368115 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a35d63a3-3f75-4fb0-89df-e85125ede049 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:45.368664 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a35d63a3-3f75-4fb0-89df-e85125ede049 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:45.369077 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a35d63a3-3f75-4fb0-89df-e85125ede049 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:45.537898 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0fbbef75-7f93-442a-ade3-782b8bc52e53 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:45.540815 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0fbbef75-7f93-442a-ade3-782b8bc52e53 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:45.549375 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0fbbef75-7f93-442a-ade3-782b8bc52e53 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:45.550372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0fbbef75-7f93-442a-ade3-782b8bc52e53 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:45.550852 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0fbbef75-7f93-442a-ade3-782b8bc52e53 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:45.551577 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0fbbef75-7f93-442a-ade3-782b8bc52e53 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:45.552032 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0fbbef75-7f93-442a-ade3-782b8bc52e53 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:45.552457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0fbbef75-7f93-442a-ade3-782b8bc52e53 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:45.555831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a35d63a3-3f75-4fb0-89df-e85125ede049 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:45.564265 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a35d63a3-3f75-4fb0-89df-e85125ede049 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1722 microversion: 2.1 time: 0.211406 Aug 26 06:21:45.564898 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 376/741] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:45 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:45.779235 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c72dcd2a-4a14-4186-a95a-12c63c724496 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:45.779851 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c72dcd2a-4a14-4186-a95a-12c63c724496 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:45.785946 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c72dcd2a-4a14-4186-a95a-12c63c724496 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:45.786441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c72dcd2a-4a14-4186-a95a-12c63c724496 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:45.786941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c72dcd2a-4a14-4186-a95a-12c63c724496 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:45.787641 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c72dcd2a-4a14-4186-a95a-12c63c724496 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:45.788093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c72dcd2a-4a14-4186-a95a-12c63c724496 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:45.788513 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c72dcd2a-4a14-4186-a95a-12c63c724496 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:45.998127 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0fbbef75-7f93-442a-ade3-782b8bc52e53 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "POST /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/action" status: 202 len: 0 microversion: 2.1 time: 0.463772 Aug 26 06:21:46.002297 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 366/742] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:21:45 2022] POST /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 06:21:46.008258 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8c8885da-419a-491b-8346-696fe8e697eb tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:46.009149 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8c8885da-419a-491b-8346-696fe8e697eb tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:46.011844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=75 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:46.017320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c8885da-419a-491b-8346-696fe8e697eb tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:46.017855 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c8885da-419a-491b-8346-696fe8e697eb tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:46.018403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c8885da-419a-491b-8346-696fe8e697eb tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:46.019638 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c72dcd2a-4a14-4186-a95a-12c63c724496 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:46.019832 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c8885da-419a-491b-8346-696fe8e697eb tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:46.020237 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c8885da-419a-491b-8346-696fe8e697eb tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:46.020677 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8c8885da-419a-491b-8346-696fe8e697eb tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:46.029508 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c72dcd2a-4a14-4186-a95a-12c63c724496 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1672 microversion: 2.1 time: 0.253999 Aug 26 06:21:46.030101 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 377/743] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:45 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1672 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:46.196801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8c8885da-419a-491b-8346-696fe8e697eb tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:46.208146 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8c8885da-419a-491b-8346-696fe8e697eb tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1753 microversion: 2.1 time: 0.204111 Aug 26 06:21:46.208734 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 367/744] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:46 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1753 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:46.397356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:46.399607 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:46.410902 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:46.411934 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:46.412592 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:46.413417 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:46.413958 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:46.414523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:46.560805 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:46.571205 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:46.577362 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:46.577362 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-931d393e-85d6-4da7-9855-b7df20cbb90d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.181209 Aug 26 06:21:46.577362 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 378/745] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:46 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:46.591183 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-220ce984-ed37-4e17-8019-7b30caf2f607 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:46.591802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-220ce984-ed37-4e17-8019-7b30caf2f607 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:46.598827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-220ce984-ed37-4e17-8019-7b30caf2f607 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:46.600015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-220ce984-ed37-4e17-8019-7b30caf2f607 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:46.600769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-220ce984-ed37-4e17-8019-7b30caf2f607 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:46.601526 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-220ce984-ed37-4e17-8019-7b30caf2f607 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:46.601988 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-220ce984-ed37-4e17-8019-7b30caf2f607 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:46.602581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-220ce984-ed37-4e17-8019-7b30caf2f607 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:46.823247 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-220ce984-ed37-4e17-8019-7b30caf2f607 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:46.832480 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-220ce984-ed37-4e17-8019-7b30caf2f607 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1722 microversion: 2.1 time: 0.244799 Aug 26 06:21:46.832988 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 368/746] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:46 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:47.053183 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-1859b383-341a-445d-9c32-9f64a37c776e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:47.053957 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1859b383-341a-445d-9c32-9f64a37c776e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:47.061146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1859b383-341a-445d-9c32-9f64a37c776e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:47.061640 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1859b383-341a-445d-9c32-9f64a37c776e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:47.062084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1859b383-341a-445d-9c32-9f64a37c776e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:47.062950 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1859b383-341a-445d-9c32-9f64a37c776e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:47.063405 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1859b383-341a-445d-9c32-9f64a37c776e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:47.063813 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1859b383-341a-445d-9c32-9f64a37c776e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:47.243079 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1c011724-b665-4cee-80bf-a3396a4849c5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:47.244657 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1c011724-b665-4cee-80bf-a3396a4849c5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:47.253595 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c011724-b665-4cee-80bf-a3396a4849c5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:47.254300 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c011724-b665-4cee-80bf-a3396a4849c5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:47.254842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c011724-b665-4cee-80bf-a3396a4849c5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:47.255843 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c011724-b665-4cee-80bf-a3396a4849c5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:47.256374 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c011724-b665-4cee-80bf-a3396a4849c5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:47.257275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1c011724-b665-4cee-80bf-a3396a4849c5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:47.340954 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1859b383-341a-445d-9c32-9f64a37c776e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:47.350060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-1859b383-341a-445d-9c32-9f64a37c776e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1672 microversion: 2.1 time: 0.301869 Aug 26 06:21:47.351057 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 379/747] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:47 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1672 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:47.439363 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1c011724-b665-4cee-80bf-a3396a4849c5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:47.461988 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1c011724-b665-4cee-80bf-a3396a4849c5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1753 microversion: 2.1 time: 0.229614 Aug 26 06:21:47.466718 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 369/748] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:47 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1753 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:47.600214 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:47.600851 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:47.616041 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:47.618469 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:47.619349 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:47.620706 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:47.621548 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:47.622365 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:47.858905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3b5d24d3-d4f2-4b2a-95be-c4938c0ca7f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:47.859990 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3b5d24d3-d4f2-4b2a-95be-c4938c0ca7f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:47.874084 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b5d24d3-d4f2-4b2a-95be-c4938c0ca7f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:47.875067 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b5d24d3-d4f2-4b2a-95be-c4938c0ca7f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:47.875836 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b5d24d3-d4f2-4b2a-95be-c4938c0ca7f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:47.877164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b5d24d3-d4f2-4b2a-95be-c4938c0ca7f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:47.878249 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b5d24d3-d4f2-4b2a-95be-c4938c0ca7f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:47.879189 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b5d24d3-d4f2-4b2a-95be-c4938c0ca7f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:47.886498 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:48.032225 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3b5d24d3-d4f2-4b2a-95be-c4938c0ca7f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:48.045479 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3b5d24d3-d4f2-4b2a-95be-c4938c0ca7f9 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1728 microversion: 2.1 time: 0.191313 Aug 26 06:21:48.045479 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 370/749] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:47 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:48.066971 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8dd7901a-c12a-439b-9bce-c5e254d5db72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:48.067553 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8dd7901a-c12a-439b-9bce-c5e254d5db72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:48.074494 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8dd7901a-c12a-439b-9bce-c5e254d5db72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:48.075068 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8dd7901a-c12a-439b-9bce-c5e254d5db72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:48.075498 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8dd7901a-c12a-439b-9bce-c5e254d5db72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:48.077667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8dd7901a-c12a-439b-9bce-c5e254d5db72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:48.077667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8dd7901a-c12a-439b-9bce-c5e254d5db72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:48.077667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8dd7901a-c12a-439b-9bce-c5e254d5db72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:48.100647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:48.110840 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:48.113349 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:48.114734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b9665eb6-c060-4f2a-961a-ddc445867433 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.519199 Aug 26 06:21:48.115498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 380/750] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:47 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:48.209503 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8dd7901a-c12a-439b-9bce-c5e254d5db72 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146994 Aug 26 06:21:48.210947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 371/751] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 06:21:48 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:21:48.373947 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-85998542-21bf-4df2-b2ff-5d5222e1f07e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:48.374473 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-85998542-21bf-4df2-b2ff-5d5222e1f07e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:48.389634 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-85998542-21bf-4df2-b2ff-5d5222e1f07e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:48.390466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-85998542-21bf-4df2-b2ff-5d5222e1f07e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:48.391273 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-85998542-21bf-4df2-b2ff-5d5222e1f07e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:48.392519 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-85998542-21bf-4df2-b2ff-5d5222e1f07e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:48.393043 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-85998542-21bf-4df2-b2ff-5d5222e1f07e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:48.395771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-85998542-21bf-4df2-b2ff-5d5222e1f07e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:48.499018 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3a1926dc-b3f4-4e7b-a90b-8f5b67b68b22 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:48.500225 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3a1926dc-b3f4-4e7b-a90b-8f5b67b68b22 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:48.521624 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3a1926dc-b3f4-4e7b-a90b-8f5b67b68b22 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:48.522435 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3a1926dc-b3f4-4e7b-a90b-8f5b67b68b22 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:48.524465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3a1926dc-b3f4-4e7b-a90b-8f5b67b68b22 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:48.525808 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3a1926dc-b3f4-4e7b-a90b-8f5b67b68b22 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:48.527886 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3a1926dc-b3f4-4e7b-a90b-8f5b67b68b22 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:48.529950 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3a1926dc-b3f4-4e7b-a90b-8f5b67b68b22 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:48.670520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-85998542-21bf-4df2-b2ff-5d5222e1f07e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:48.684315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-85998542-21bf-4df2-b2ff-5d5222e1f07e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1672 microversion: 2.1 time: 0.314482 Aug 26 06:21:48.685708 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 381/752] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:48 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1672 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:48.905940 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3a1926dc-b3f4-4e7b-a90b-8f5b67b68b22 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:48.929137 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3a1926dc-b3f4-4e7b-a90b-8f5b67b68b22 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1753 microversion: 2.1 time: 0.446125 Aug 26 06:21:48.930031 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 372/753] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:48 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1753 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:49.142517 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:49.144117 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:49.151574 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:49.152782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:49.153769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:49.155242 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:49.156529 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:49.157483 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:49.582046 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:49.620432 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c5da3bee-5761-45ad-b338-b24d80eb7e52 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:49.622295 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c5da3bee-5761-45ad-b338-b24d80eb7e52 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:49.636870 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c5da3bee-5761-45ad-b338-b24d80eb7e52 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:49.638145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c5da3bee-5761-45ad-b338-b24d80eb7e52 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:49.639252 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c5da3bee-5761-45ad-b338-b24d80eb7e52 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:49.640844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c5da3bee-5761-45ad-b338-b24d80eb7e52 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:49.641975 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c5da3bee-5761-45ad-b338-b24d80eb7e52 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:49.643171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c5da3bee-5761-45ad-b338-b24d80eb7e52 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:49.669606 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:49.673460 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:49.677926 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4a060ce9-154a-4ff7-836c-e54ba7dc1241 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.541979 Aug 26 06:21:49.695748 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 382/754] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:49 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:49.717156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c5da3bee-5761-45ad-b338-b24d80eb7e52 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:21:49.725735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-29247284-403d-4a20-930a-0311f096af26 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:49.729063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-29247284-403d-4a20-930a-0311f096af26 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:49.772935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29247284-403d-4a20-930a-0311f096af26 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:49.773740 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29247284-403d-4a20-930a-0311f096af26 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:49.782848 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29247284-403d-4a20-930a-0311f096af26 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:49.785565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29247284-403d-4a20-930a-0311f096af26 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:49.789120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29247284-403d-4a20-930a-0311f096af26 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:49.791486 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29247284-403d-4a20-930a-0311f096af26 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:49.943213 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-29247284-403d-4a20-930a-0311f096af26 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:49.954021 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-29247284-403d-4a20-930a-0311f096af26 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1605 microversion: 2.1 time: 0.250510 Aug 26 06:21:49.957804 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 383/755] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:49 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1605 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:49.967356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-32cf657d-fb38-4a46-bb51-dd0f37b76d0d req-0ecc77c2-fa78-4c0c-b252-2349403d7634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0dda9da-e7bd-4a7d-b807-a2074ccbe208", "name": "network-vif-deleted", "tag": "eb6ebb39-9a85-4eaa-88a1-9d3aff9f8785"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:49.981009 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-32cf657d-fb38-4a46-bb51-dd0f37b76d0d req-0ecc77c2-fa78-4c0c-b252-2349403d7634 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:49.981660 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-32cf657d-fb38-4a46-bb51-dd0f37b76d0d req-0ecc77c2-fa78-4c0c-b252-2349403d7634 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:49.982206 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-32cf657d-fb38-4a46-bb51-dd0f37b76d0d req-0ecc77c2-fa78-4c0c-b252-2349403d7634 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:49.997920 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-32cf657d-fb38-4a46-bb51-dd0f37b76d0d req-0ecc77c2-fa78-4c0c-b252-2349403d7634 service nova] Creating event network-vif-deleted:eb6ebb39-9a85-4eaa-88a1-9d3aff9f8785 for instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 on hv-cinder-85391 Aug 26 06:21:50.006550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-32cf657d-fb38-4a46-bb51-dd0f37b76d0d req-0ecc77c2-fa78-4c0c-b252-2349403d7634 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045506 Aug 26 06:21:50.009476 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 384/756] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:21:50.021643 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-91005dd2-ee03-4a40-bd49-050dd09b4d7a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:50.022410 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-91005dd2-ee03-4a40-bd49-050dd09b4d7a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:50.032003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91005dd2-ee03-4a40-bd49-050dd09b4d7a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:50.032763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91005dd2-ee03-4a40-bd49-050dd09b4d7a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:50.033562 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91005dd2-ee03-4a40-bd49-050dd09b4d7a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:50.034663 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91005dd2-ee03-4a40-bd49-050dd09b4d7a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:50.035301 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91005dd2-ee03-4a40-bd49-050dd09b4d7a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:50.036279 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-91005dd2-ee03-4a40-bd49-050dd09b4d7a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:50.270143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-91005dd2-ee03-4a40-bd49-050dd09b4d7a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:50.288849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-91005dd2-ee03-4a40-bd49-050dd09b4d7a tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1753 microversion: 2.1 time: 0.272798 Aug 26 06:21:50.289886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 385/757] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:50 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1753 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:50.686948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-74227dd2-cc64-4c84-acf1-7d5adc5faa89 req-17736d3a-9d5b-44e5-a6f7-18f41296ba71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45330505-4b58-4762-bb9f-e704f9648e1e", "tag": "2064b241-4b48-43a2-ba54-14c868b539b4"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:50.701365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c5da3bee-5761-45ad-b338-b24d80eb7e52 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "DELETE /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 204 len: 0 microversion: 2.1 time: 1.088182 Aug 26 06:21:50.706516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 373/758] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:21:49 2022] DELETE /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 0 bytes in 1091 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:21:50.714163 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-10cdae31-e979-4c93-865f-aa3251c99ece tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:50.715242 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-10cdae31-e979-4c93-865f-aa3251c99ece tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:50.719292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-74227dd2-cc64-4c84-acf1-7d5adc5faa89 req-17736d3a-9d5b-44e5-a6f7-18f41296ba71 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:50.731034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-74227dd2-cc64-4c84-acf1-7d5adc5faa89 req-17736d3a-9d5b-44e5-a6f7-18f41296ba71 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:50.733240 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-74227dd2-cc64-4c84-acf1-7d5adc5faa89 req-17736d3a-9d5b-44e5-a6f7-18f41296ba71 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:50.734747 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10cdae31-e979-4c93-865f-aa3251c99ece tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:50.741045 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10cdae31-e979-4c93-865f-aa3251c99ece tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:50.741480 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10cdae31-e979-4c93-865f-aa3251c99ece tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:50.742531 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10cdae31-e979-4c93-865f-aa3251c99ece tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:50.743339 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10cdae31-e979-4c93-865f-aa3251c99ece tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:50.743982 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10cdae31-e979-4c93-865f-aa3251c99ece tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:50.757895 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-74227dd2-cc64-4c84-acf1-7d5adc5faa89 req-17736d3a-9d5b-44e5-a6f7-18f41296ba71 service nova] Creating event network-changed:2064b241-4b48-43a2-ba54-14c868b539b4 for instance 45330505-4b58-4762-bb9f-e704f9648e1e on hv-cinder-85391 Aug 26 06:21:50.804500 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-74227dd2-cc64-4c84-acf1-7d5adc5faa89 req-17736d3a-9d5b-44e5-a6f7-18f41296ba71 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119892 Aug 26 06:21:50.807365 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 386/759] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:21:50.821137 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:50.824000 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:50.837747 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:50.839123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:50.840302 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:50.842911 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:50.844213 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:50.846055 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:51.025562 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-10cdae31-e979-4c93-865f-aa3251c99ece tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:51.035298 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-10cdae31-e979-4c93-865f-aa3251c99ece tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1513 microversion: 2.1 time: 0.325860 Aug 26 06:21:51.043805 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 374/760] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:50 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1513 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:51.054239 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ddceed15-624e-4bee-968c-01e09eda7808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:51.055485 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ddceed15-624e-4bee-968c-01e09eda7808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:51.088265 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ddceed15-624e-4bee-968c-01e09eda7808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:51.088797 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ddceed15-624e-4bee-968c-01e09eda7808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:51.090947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ddceed15-624e-4bee-968c-01e09eda7808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:51.090947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ddceed15-624e-4bee-968c-01e09eda7808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:51.107573 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ddceed15-624e-4bee-968c-01e09eda7808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:51.111013 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ddceed15-624e-4bee-968c-01e09eda7808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:51.180121 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:51.199731 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:51.203630 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:51.206370 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-562a677c-64fa-49cd-9365-814a6b4eb8ec tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.396397 Aug 26 06:21:51.208735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 387/761] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:50 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:51.257902 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ddceed15-624e-4bee-968c-01e09eda7808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:51.266836 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ddceed15-624e-4bee-968c-01e09eda7808 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1322 microversion: 2.1 time: 0.221689 Aug 26 06:21:51.267839 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 375/762] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:51 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:51.321730 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8df996f6-9316-4f7e-a618-c46f29786dd5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:51.322339 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8df996f6-9316-4f7e-a618-c46f29786dd5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:51.335450 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8df996f6-9316-4f7e-a618-c46f29786dd5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:51.335936 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8df996f6-9316-4f7e-a618-c46f29786dd5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:51.336377 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8df996f6-9316-4f7e-a618-c46f29786dd5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:51.337201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8df996f6-9316-4f7e-a618-c46f29786dd5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:51.337710 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8df996f6-9316-4f7e-a618-c46f29786dd5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:51.338281 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8df996f6-9316-4f7e-a618-c46f29786dd5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:51.569233 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8df996f6-9316-4f7e-a618-c46f29786dd5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:51.581886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8df996f6-9316-4f7e-a618-c46f29786dd5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.267606 Aug 26 06:21:51.583015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 388/763] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:51 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:52.058586 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7d083aec-6496-47db-a31b-341758c59a56 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:52.059317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7d083aec-6496-47db-a31b-341758c59a56 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:52.067033 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d083aec-6496-47db-a31b-341758c59a56 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:52.067525 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d083aec-6496-47db-a31b-341758c59a56 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:52.067967 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d083aec-6496-47db-a31b-341758c59a56 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:52.068751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d083aec-6496-47db-a31b-341758c59a56 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:52.069209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d083aec-6496-47db-a31b-341758c59a56 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:52.069644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d083aec-6496-47db-a31b-341758c59a56 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:52.227065 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7d083aec-6496-47db-a31b-341758c59a56 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:52.235749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:52.236360 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7d083aec-6496-47db-a31b-341758c59a56 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1513 microversion: 2.1 time: 0.181723 Aug 26 06:21:52.236451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:52.236889 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 376/764] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:52 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:52.244118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:52.244693 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:52.245222 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:52.245994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:52.246525 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:52.247034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:52.290789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-025ffdc9-4667-4a4e-abd0-a86788521532 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:52.292160 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-025ffdc9-4667-4a4e-abd0-a86788521532 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:52.305514 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-025ffdc9-4667-4a4e-abd0-a86788521532 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:52.306086 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-025ffdc9-4667-4a4e-abd0-a86788521532 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:52.306531 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-025ffdc9-4667-4a4e-abd0-a86788521532 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:52.307320 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-025ffdc9-4667-4a4e-abd0-a86788521532 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:52.307790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-025ffdc9-4667-4a4e-abd0-a86788521532 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:52.313394 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-025ffdc9-4667-4a4e-abd0-a86788521532 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:52.414027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-025ffdc9-4667-4a4e-abd0-a86788521532 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:52.429384 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-025ffdc9-4667-4a4e-abd0-a86788521532 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1322 microversion: 2.1 time: 0.142956 Aug 26 06:21:52.430407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 377/765] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:52 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:52.459358 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:52.461771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:52.469348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:52.470803 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:52.472109 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-51ca1323-00b2-4d25-9533-b94be552c88f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.241853 Aug 26 06:21:52.472690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 389/766] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:52 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:21:52.605171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1e50c47e-26ee-4dc1-81d6-288f7359b7d8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:52.605932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1e50c47e-26ee-4dc1-81d6-288f7359b7d8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:52.612580 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e50c47e-26ee-4dc1-81d6-288f7359b7d8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:52.613382 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e50c47e-26ee-4dc1-81d6-288f7359b7d8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:52.613638 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e50c47e-26ee-4dc1-81d6-288f7359b7d8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:52.614565 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e50c47e-26ee-4dc1-81d6-288f7359b7d8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:52.615073 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e50c47e-26ee-4dc1-81d6-288f7359b7d8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:52.615518 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e50c47e-26ee-4dc1-81d6-288f7359b7d8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:52.804444 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1e50c47e-26ee-4dc1-81d6-288f7359b7d8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:52.812587 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1e50c47e-26ee-4dc1-81d6-288f7359b7d8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.211241 Aug 26 06:21:52.813150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 378/767] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:52 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:52.838213 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-0be7365d-b7f1-47fb-b949-7227d7fe4cc9 req-a63ffd2b-9a58-408f-a6c5-dd0c712f6073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45330505-4b58-4762-bb9f-e704f9648e1e", "tag": "2064b241-4b48-43a2-ba54-14c868b539b4"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:52.858649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-0be7365d-b7f1-47fb-b949-7227d7fe4cc9 req-a63ffd2b-9a58-408f-a6c5-dd0c712f6073 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:52.863445 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-0be7365d-b7f1-47fb-b949-7227d7fe4cc9 req-a63ffd2b-9a58-408f-a6c5-dd0c712f6073 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:52.864784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-0be7365d-b7f1-47fb-b949-7227d7fe4cc9 req-a63ffd2b-9a58-408f-a6c5-dd0c712f6073 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:52.901400 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-0be7365d-b7f1-47fb-b949-7227d7fe4cc9 req-a63ffd2b-9a58-408f-a6c5-dd0c712f6073 service nova] Creating event network-changed:2064b241-4b48-43a2-ba54-14c868b539b4 for instance 45330505-4b58-4762-bb9f-e704f9648e1e on hv-cinder-85391 Aug 26 06:21:52.907299 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-0be7365d-b7f1-47fb-b949-7227d7fe4cc9 req-a63ffd2b-9a58-408f-a6c5-dd0c712f6073 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073430 Aug 26 06:21:52.907895 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 390/768] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:21:53.259334 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-29287b02-5d95-4b28-a75d-c6a1ab42806a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:53.259334 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-29287b02-5d95-4b28-a75d-c6a1ab42806a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:53.268254 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29287b02-5d95-4b28-a75d-c6a1ab42806a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:53.270022 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29287b02-5d95-4b28-a75d-c6a1ab42806a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:53.271964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29287b02-5d95-4b28-a75d-c6a1ab42806a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:53.272956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29287b02-5d95-4b28-a75d-c6a1ab42806a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:53.273609 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29287b02-5d95-4b28-a75d-c6a1ab42806a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:53.274242 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-29287b02-5d95-4b28-a75d-c6a1ab42806a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:53.453849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:53.455298 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:53.475461 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:53.476209 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:53.477469 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:53.478540 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:53.479206 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:53.479808 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:53.570106 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:53.570582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:53.571338 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:53.574581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-29287b02-5d95-4b28-a75d-c6a1ab42806a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:53.579541 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lazy-loading 'fault' on Instance uuid c0dda9da-e7bd-4a7d-b807-a2074ccbe208 {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:21:53.594317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-29287b02-5d95-4b28-a75d-c6a1ab42806a tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1513 microversion: 2.1 time: 0.340766 Aug 26 06:21:53.599857 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 379/769] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:53 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1513 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:53.605044 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:53.613317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:53.642836 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:53.644127 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:53.644709 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:53.645581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:53.646082 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:53.648147 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:53.754245 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:53.763091 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c04bc9fb-f156-4a24-baaa-ebe808d77da2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1327 microversion: 2.1 time: 0.313996 Aug 26 06:21:53.763737 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 391/770] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:53 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1327 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:53.835929 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4fc53394-2aa4-47eb-9837-aeaaa05a36fa tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:53.836649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4fc53394-2aa4-47eb-9837-aeaaa05a36fa tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:53.843085 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4fc53394-2aa4-47eb-9837-aeaaa05a36fa tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:53.843611 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4fc53394-2aa4-47eb-9837-aeaaa05a36fa tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:53.844077 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4fc53394-2aa4-47eb-9837-aeaaa05a36fa tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:53.844794 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4fc53394-2aa4-47eb-9837-aeaaa05a36fa tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:53.845251 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4fc53394-2aa4-47eb-9837-aeaaa05a36fa tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:53.845677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4fc53394-2aa4-47eb-9837-aeaaa05a36fa tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:53.861657 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:53.871626 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:53.872976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:53.874421 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1269cbba-a722-47e5-ae9b-9711be71ebf2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1808 microversion: 2.20 time: 0.273302 Aug 26 06:21:53.875022 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 380/771] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:53 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:21:54.075116 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-42f6ba10-5a0d-4af1-9969-4c6b06025ce1 req-3188bafe-2efe-49b4-afb0-e68aadf0cfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49523656-e2db-453f-a79f-435e6991bacc", "name": "network-vif-deleted", "tag": "591cc0d6-3149-4691-91d0-6ea7e9e1679f"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:54.089761 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-42f6ba10-5a0d-4af1-9969-4c6b06025ce1 req-3188bafe-2efe-49b4-afb0-e68aadf0cfda service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:54.090092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4fc53394-2aa4-47eb-9837-aeaaa05a36fa tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:54.090240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-42f6ba10-5a0d-4af1-9969-4c6b06025ce1 req-3188bafe-2efe-49b4-afb0-e68aadf0cfda service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:54.090740 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-42f6ba10-5a0d-4af1-9969-4c6b06025ce1 req-3188bafe-2efe-49b4-afb0-e68aadf0cfda service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:54.102157 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4fc53394-2aa4-47eb-9837-aeaaa05a36fa tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.270696 Aug 26 06:21:54.104638 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 392/772] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:53 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:54.106444 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-42f6ba10-5a0d-4af1-9969-4c6b06025ce1 req-3188bafe-2efe-49b4-afb0-e68aadf0cfda service nova] Creating event network-vif-deleted:591cc0d6-3149-4691-91d0-6ea7e9e1679f for instance 49523656-e2db-453f-a79f-435e6991bacc on hv-cinder-85391 Aug 26 06:21:54.112742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-42f6ba10-5a0d-4af1-9969-4c6b06025ce1 req-3188bafe-2efe-49b4-afb0-e68aadf0cfda service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042785 Aug 26 06:21:54.115714 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 381/773] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:21:54.625098 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-46160371-1c56-4fac-9cfd-7245d1102fd4 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:54.626447 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-46160371-1c56-4fac-9cfd-7245d1102fd4 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:54.637221 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46160371-1c56-4fac-9cfd-7245d1102fd4 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:54.638450 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46160371-1c56-4fac-9cfd-7245d1102fd4 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:54.639478 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46160371-1c56-4fac-9cfd-7245d1102fd4 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:54.640824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46160371-1c56-4fac-9cfd-7245d1102fd4 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:54.641889 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46160371-1c56-4fac-9cfd-7245d1102fd4 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:54.642675 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46160371-1c56-4fac-9cfd-7245d1102fd4 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:54.727791 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-46160371-1c56-4fac-9cfd-7245d1102fd4 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:54.738495 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-46160371-1c56-4fac-9cfd-7245d1102fd4 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1303 microversion: 2.1 time: 0.119396 Aug 26 06:21:54.739370 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 393/774] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:54 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:54.787169 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:54.789004 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:54.797824 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:54.798830 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:54.799351 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:54.800481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:54.801353 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:54.802211 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:54.850791 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:54.851518 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:54.852192 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:54.852735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lazy-loading 'fault' on Instance uuid c0dda9da-e7bd-4a7d-b807-a2074ccbe208 {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:21:54.904455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:54.905172 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:54.913038 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:54.913897 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:54.914769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:54.915747 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:54.923501 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:54.923501 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:54.923743 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:54.931720 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9560506b-a0bf-4118-967a-0878116bb898 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 200 len: 1327 microversion: 2.1 time: 0.149775 Aug 26 06:21:54.932443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 382/775] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:54 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 1327 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:55.091366 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:55.104617 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:55.106676 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:55.108137 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e4afea2e-0dc1-4168-a857-0916b22fb1db tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1795 microversion: 2.20 time: 0.207792 Aug 26 06:21:55.109546 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 394/776] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:21:54 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1795 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:21:55.141863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d1a7d860-1c86-4ab9-8d7e-03e1f61773d0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:55.142729 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d1a7d860-1c86-4ab9-8d7e-03e1f61773d0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:55.154670 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1a7d860-1c86-4ab9-8d7e-03e1f61773d0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:55.155216 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1a7d860-1c86-4ab9-8d7e-03e1f61773d0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:55.155658 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1a7d860-1c86-4ab9-8d7e-03e1f61773d0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:55.156369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1a7d860-1c86-4ab9-8d7e-03e1f61773d0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:55.156830 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1a7d860-1c86-4ab9-8d7e-03e1f61773d0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:55.157319 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1a7d860-1c86-4ab9-8d7e-03e1f61773d0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:55.399760 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d1a7d860-1c86-4ab9-8d7e-03e1f61773d0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:55.408853 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d1a7d860-1c86-4ab9-8d7e-03e1f61773d0 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.271099 Aug 26 06:21:55.409906 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 383/777] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:55 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:21:55.766236 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:55.767307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:55.777531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:55.777890 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:55.778333 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:55.779094 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:55.779556 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:55.780082 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:55.812178 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:55.812698 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:55.813130 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:55.813577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lazy-loading 'fault' on Instance uuid 49523656-e2db-453f-a79f-435e6991bacc {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:21:55.863348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:55.873504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a7d49cb7-b437-4cda-8321-a4873fdb8830 tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1308 microversion: 2.1 time: 0.111765 Aug 26 06:21:55.874160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 395/778] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:55 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:55.953612 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:55.954357 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:55.961724 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:55.962222 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:55.962680 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:55.963396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:55.963838 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:55.964259 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:55.981353 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] HTTP exception thrown: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Request method failure captured: Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 HTTP/1.1 Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGVEi2sDXAvdvv0HOjOhYG6O-5VK8zNRXflkr7zgg20kn-Pl3aXACI09HI_Bzo_JAoPt_SKluW9p9eIX44jqqougK0jcKZduIAPehwvlKYPagzLHHrZ77XFhCi8EgJB16YzWV-h6lpMKhj3GrHQboIpM60heVYH7Z-nR8p0FfSXnXfs Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:21:55.983102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aceecfa04cf941348d542c3e55569384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aceecfa04cf941348d542c3e55569384"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 1d22ea3fb8fa4bd99537fb83279b2d24 Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:21:55.984678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'c0dda9da-e7bd-4a7d-b807-a2074ccbe208'} Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:21:55.985588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:21:55.987582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:55.988997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Returning 404 to user: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:21:55.988997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-732dc4d3-88d9-43a5-9c09-29389354ee50 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 404 len: 111 microversion: 2.1 time: 0.034842 Aug 26 06:21:55.988997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 384/779] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:55 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:21:55.995241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f6e48c82-ee00-43f0-99ce-c6a746df0ade tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '.version_select at 0x7f2f08fd79d0>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:56.163917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f6e48c82-ee00-43f0-99ce-c6a746df0ade tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327008289" status: 202 len: 0 microversion: 2.1 time: 0.173183 Aug 26 06:21:56.164490 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 396/780] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 26 06:21:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327008289 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:21:56.430943 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-620b0f40-337f-408f-a6b0-d37128d5f6a8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:56.431765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-620b0f40-337f-408f-a6b0-d37128d5f6a8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:56.452096 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-620b0f40-337f-408f-a6b0-d37128d5f6a8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:56.453117 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-620b0f40-337f-408f-a6b0-d37128d5f6a8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:56.454828 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-620b0f40-337f-408f-a6b0-d37128d5f6a8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:56.456684 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-620b0f40-337f-408f-a6b0-d37128d5f6a8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:56.457267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-620b0f40-337f-408f-a6b0-d37128d5f6a8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:56.458658 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-620b0f40-337f-408f-a6b0-d37128d5f6a8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:56.912411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-620b0f40-337f-408f-a6b0-d37128d5f6a8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:56.912411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-620b0f40-337f-408f-a6b0-d37128d5f6a8 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.234952 Aug 26 06:21:56.912411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 385/781] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:56 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:56.914023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:56.914023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:56.915102 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:56.915829 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:56.916477 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:56.917515 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:56.918249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:56.918980 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:56.963710 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:56.964245 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:56.964735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:56.965625 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lazy-loading 'fault' on Instance uuid 49523656-e2db-453f-a79f-435e6991bacc {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:21:57.009206 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '543a9cddd92a44c78c26e5b8400e0c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e90dec3a44a4763b0045af64212fc15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:57.019091 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5022bb05-8a94-41d5-9c06-50366d68362b tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 200 len: 1308 microversion: 2.1 time: 0.118847 Aug 26 06:21:57.019671 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 397/782] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:56 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:57.290294 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6d84a74b-4715-4433-ac5d-2d36bd329f3d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Action: 'create', calling method: .version_select at 0x7f2f08e9eb80>, body: {"keypair": {"name": "tempest-keypair-417126570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2js9V7Kl9bdZ3P9/IAjG7WiKMvpLCHtxIisHLP7Lq6EHcZz7mRaLs8q4t+Jxi3rYASMdh6HzGpODWgLJS1u++RGxouFNhrHvXd4YY+n3h6aRkpa1iM9kMYnP+AiQGEig=="}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:21:57.315736 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-6d84a74b-4715-4433-ac5d-2d36bd329f3d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Getting quotas for project aceecfa04cf941348d542c3e55569384. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:21:57.321572 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-6d84a74b-4715-4433-ac5d-2d36bd329f3d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Getting quotas for user 1d22ea3fb8fa4bd99537fb83279b2d24 and project aceecfa04cf941348d542c3e55569384. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:21:57.490887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6d84a74b-4715-4433-ac5d-2d36bd329f3d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.206540 Aug 26 06:21:57.491733 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 386/783] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 06:21:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:21:57.910822 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-06da823d-58e7-4901-819b-632372f403f9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:57.911446 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-06da823d-58e7-4901-819b-632372f403f9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:57.918501 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06da823d-58e7-4901-819b-632372f403f9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:57.919232 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06da823d-58e7-4901-819b-632372f403f9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:57.919666 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06da823d-58e7-4901-819b-632372f403f9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:57.920513 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06da823d-58e7-4901-819b-632372f403f9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:57.920660 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06da823d-58e7-4901-819b-632372f403f9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:57.921089 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06da823d-58e7-4901-819b-632372f403f9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:58.040506 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:58.041366 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] [instance: 49523656-e2db-453f-a79f-435e6991bacc] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:58.049673 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:58.050550 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:58.051053 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:58.051821 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:58.055284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:58.071929 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:58.072800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] HTTP exception thrown: Instance 49523656-e2db-453f-a79f-435e6991bacc could not be found. Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Request method failure captured: Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc HTTP/1.1 Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGWots-SUETL-YrEQiYZEk4119qZVEGts-PNj41yzjQAOiqUsmDUgri5u0QBxPQsdUbp51DBd2qSU49hQLnqYQokpBhjznlxqRa-RLZU0JsonSWdwnovtrHGrYYTSqqE17S-Mdk7nQM-Kq5Kqsk5G20rOQFH8krnsK8ku3Q5Gg4S9GI Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: 7e90dec3a44a4763b0045af64212fc15 Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-VolumesSnapshotTestJSON-913086289 Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:21:58.074439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7e90dec3a44a4763b0045af64212fc15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7e90dec3a44a4763b0045af64212fc15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7e90dec3a44a4763b0045af64212fc15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7e90dec3a44a4763b0045af64212fc15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-VolumesSnapshotTestJSON-913086289 Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: 7e90dec3a44a4763b0045af64212fc15 Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-913086289 Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-VolumesSnapshotTestJSON-913086289-project Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 543a9cddd92a44c78c26e5b8400e0c98 Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-VolumesSnapshotTestJSON-913086289-project Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance 49523656-e2db-453f-a79f-435e6991bacc could not be found. Aug 26 06:21:58.076002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '49523656-e2db-453f-a79f-435e6991bacc'} Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49523656-e2db-453f-a79f-435e6991bacc could not be found. Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:21:58.076772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49523656-e2db-453f-a79f-435e6991bacc could not be found. Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49523656-e2db-453f-a79f-435e6991bacc could not be found. Aug 26 06:21:58.078166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:21:58.081304 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] Returning 404 to user: Instance 49523656-e2db-453f-a79f-435e6991bacc could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:21:58.082280 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e3f12e97-8043-4e32-aa42-ecc59dbeecac tempest-VolumesSnapshotTestJSON-913086289 tempest-VolumesSnapshotTestJSON-913086289-project] 10.222.0.40 "GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc" status: 404 len: 111 microversion: 2.1 time: 0.045711 Aug 26 06:21:58.082995 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 387/784] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:58 2022] GET /compute/v2.1/servers/49523656-e2db-453f-a79f-435e6991bacc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:21:58.389528 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-06da823d-58e7-4901-819b-632372f403f9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:58.397393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-06da823d-58e7-4901-819b-632372f403f9 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.490454 Aug 26 06:21:58.398110 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 398/785] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:57 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:21:59.421796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1ca4e4be-9197-432c-b7e0-fe6cc08f3319 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:21:59.422402 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1ca4e4be-9197-432c-b7e0-fe6cc08f3319 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:21:59.430489 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1ca4e4be-9197-432c-b7e0-fe6cc08f3319 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:59.431361 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1ca4e4be-9197-432c-b7e0-fe6cc08f3319 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:59.436203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1ca4e4be-9197-432c-b7e0-fe6cc08f3319 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:59.436203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1ca4e4be-9197-432c-b7e0-fe6cc08f3319 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:21:59.436203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1ca4e4be-9197-432c-b7e0-fe6cc08f3319 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:21:59.436203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1ca4e4be-9197-432c-b7e0-fe6cc08f3319 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:21:59.438880 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:21:59.603678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1ca4e4be-9197-432c-b7e0-fe6cc08f3319 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:21:59.616663 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1ca4e4be-9197-432c-b7e0-fe6cc08f3319 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.198919 Aug 26 06:21:59.617242 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 388/786] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:21:59 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:00.639411 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c9669525-afe5-45ca-ac50-317b96c1dc51 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:00.640215 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c9669525-afe5-45ca-ac50-317b96c1dc51 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:00.647799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c9669525-afe5-45ca-ac50-317b96c1dc51 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:00.648280 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c9669525-afe5-45ca-ac50-317b96c1dc51 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:00.648771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c9669525-afe5-45ca-ac50-317b96c1dc51 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:00.649467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c9669525-afe5-45ca-ac50-317b96c1dc51 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:00.649923 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c9669525-afe5-45ca-ac50-317b96c1dc51 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:00.650339 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c9669525-afe5-45ca-ac50-317b96c1dc51 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:00.834173 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c9669525-afe5-45ca-ac50-317b96c1dc51 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:00.844247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c9669525-afe5-45ca-ac50-317b96c1dc51 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.208719 Aug 26 06:22:00.844834 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 399/787] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:00 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:22:01.560814 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-358303472", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d86ecc4-b89c-4670-82c2-e19913819bab"}], "security_groups": [{"name": "tempest-securitygroup--764522722"}], "key_name": "tempest-keypair-417126570", "user_data": "}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:22:01.673828 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] validate_networks() for [('9d86ecc4-b89c-4670-82c2-e19913819bab', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:22:01.868712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-58fbd7e3-2fb3-4969-826d-c4a388cae242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:01.869290 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-58fbd7e3-2fb3-4969-826d-c4a388cae242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:01.876041 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58fbd7e3-2fb3-4969-826d-c4a388cae242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:01.876531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58fbd7e3-2fb3-4969-826d-c4a388cae242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:01.876961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58fbd7e3-2fb3-4969-826d-c4a388cae242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:01.877795 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58fbd7e3-2fb3-4969-826d-c4a388cae242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:01.878244 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58fbd7e3-2fb3-4969-826d-c4a388cae242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:01.878688 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-58fbd7e3-2fb3-4969-826d-c4a388cae242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:02.045038 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-58fbd7e3-2fb3-4969-826d-c4a388cae242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:02.056285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-58fbd7e3-2fb3-4969-826d-c4a388cae242 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.192842 Aug 26 06:22:02.056873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 400/788] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:01 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:02.405124 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:22:02.405822 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:22:02.406648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:22:02.407488 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:22:02.408127 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:22:02.419016 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:02.419506 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:02.419944 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:02.420705 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:02.421160 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:02.421586 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:02.438502 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Getting quotas for project aceecfa04cf941348d542c3e55569384. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:22:02.443256 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Getting quotas for user 1d22ea3fb8fa4bd99537fb83279b2d24 and project aceecfa04cf941348d542c3e55569384. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:22:02.454099 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:22:02.457132 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:22:02.685696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6c7ea4f7-3fbe-4a52-9c6d-74694147cab4 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.129580 Aug 26 06:22:02.686676 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 389/789] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:22:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:22:02.698716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cfea4c0b-cf6f-49ad-a870-273723ad20ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:02.702258 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-cfea4c0b-cf6f-49ad-a870-273723ad20ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:02.760110 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cfea4c0b-cf6f-49ad-a870-273723ad20ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:02.763712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cfea4c0b-cf6f-49ad-a870-273723ad20ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1236 microversion: 2.1 time: 0.068929 Aug 26 06:22:02.764195 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 401/790] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:02 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:03.077502 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-977d91f4-d98c-4380-afde-4409d94fc206 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:03.078123 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-977d91f4-d98c-4380-afde-4409d94fc206 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:03.086703 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-977d91f4-d98c-4380-afde-4409d94fc206 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:03.087205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-977d91f4-d98c-4380-afde-4409d94fc206 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:03.087650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-977d91f4-d98c-4380-afde-4409d94fc206 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:03.088392 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-977d91f4-d98c-4380-afde-4409d94fc206 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:03.088846 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-977d91f4-d98c-4380-afde-4409d94fc206 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:03.089269 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-977d91f4-d98c-4380-afde-4409d94fc206 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:03.248086 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-977d91f4-d98c-4380-afde-4409d94fc206 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:03.258205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-977d91f4-d98c-4380-afde-4409d94fc206 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.184628 Aug 26 06:22:03.258785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 390/791] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:03 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:03.785327 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-29f93f21-1885-4a01-bd2f-cb797bce1f2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:03.785987 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-29f93f21-1885-4a01-bd2f-cb797bce1f2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:03.839776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-29f93f21-1885-4a01-bd2f-cb797bce1f2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:03.848273 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-29f93f21-1885-4a01-bd2f-cb797bce1f2c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1236 microversion: 2.1 time: 0.067479 Aug 26 06:22:03.848833 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 402/792] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:03 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:04.281095 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0aaf3b9b-4761-40ea-82de-e679c38f8c57 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:04.284758 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0aaf3b9b-4761-40ea-82de-e679c38f8c57 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:04.290218 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0aaf3b9b-4761-40ea-82de-e679c38f8c57 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:04.290778 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0aaf3b9b-4761-40ea-82de-e679c38f8c57 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:04.291214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0aaf3b9b-4761-40ea-82de-e679c38f8c57 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:04.291905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0aaf3b9b-4761-40ea-82de-e679c38f8c57 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:04.292356 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0aaf3b9b-4761-40ea-82de-e679c38f8c57 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:04.292844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0aaf3b9b-4761-40ea-82de-e679c38f8c57 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:04.445365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0aaf3b9b-4761-40ea-82de-e679c38f8c57 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:04.454930 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0aaf3b9b-4761-40ea-82de-e679c38f8c57 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.177941 Aug 26 06:22:04.456442 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 391/793] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:04 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:04.869275 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6dd8187b-d4a7-46f3-b607-00b8628f8a9c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:04.869798 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6dd8187b-d4a7-46f3-b607-00b8628f8a9c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:04.876350 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6dd8187b-d4a7-46f3-b607-00b8628f8a9c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:04.876829 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6dd8187b-d4a7-46f3-b607-00b8628f8a9c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:04.877272 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6dd8187b-d4a7-46f3-b607-00b8628f8a9c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:04.878518 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6dd8187b-d4a7-46f3-b607-00b8628f8a9c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:04.879160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6dd8187b-d4a7-46f3-b607-00b8628f8a9c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:04.879585 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6dd8187b-d4a7-46f3-b607-00b8628f8a9c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:04.947194 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6dd8187b-d4a7-46f3-b607-00b8628f8a9c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:04.955007 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6dd8187b-d4a7-46f3-b607-00b8628f8a9c tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1240 microversion: 2.1 time: 0.089696 Aug 26 06:22:04.955624 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 403/794] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:04 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:05.476950 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-25627e81-9649-4d03-8503-7665bf3f4334 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:05.477505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-25627e81-9649-4d03-8503-7665bf3f4334 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:05.484271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-25627e81-9649-4d03-8503-7665bf3f4334 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:05.484844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-25627e81-9649-4d03-8503-7665bf3f4334 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:05.485326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-25627e81-9649-4d03-8503-7665bf3f4334 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:05.486041 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-25627e81-9649-4d03-8503-7665bf3f4334 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:05.486500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-25627e81-9649-4d03-8503-7665bf3f4334 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:05.487242 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-25627e81-9649-4d03-8503-7665bf3f4334 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:05.648089 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-25627e81-9649-4d03-8503-7665bf3f4334 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:05.657249 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-25627e81-9649-4d03-8503-7665bf3f4334 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.184152 Aug 26 06:22:05.657826 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 392/795] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:05 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:05.977555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-26689c79-b7d1-414d-a390-5dafa538b3f0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:05.978190 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-26689c79-b7d1-414d-a390-5dafa538b3f0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:05.989069 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26689c79-b7d1-414d-a390-5dafa538b3f0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:05.989479 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26689c79-b7d1-414d-a390-5dafa538b3f0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:05.989923 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26689c79-b7d1-414d-a390-5dafa538b3f0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:05.990798 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26689c79-b7d1-414d-a390-5dafa538b3f0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:05.991454 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26689c79-b7d1-414d-a390-5dafa538b3f0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:05.991711 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26689c79-b7d1-414d-a390-5dafa538b3f0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:06.064910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-26689c79-b7d1-414d-a390-5dafa538b3f0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:06.073574 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-26689c79-b7d1-414d-a390-5dafa538b3f0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1288 microversion: 2.1 time: 0.099871 Aug 26 06:22:06.077796 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 404/796] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:05 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:06.683817 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2b9121cd-1415-4e2e-9164-b48c4a8511ea tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:06.683817 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2b9121cd-1415-4e2e-9164-b48c4a8511ea tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:06.690238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2b9121cd-1415-4e2e-9164-b48c4a8511ea tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:06.690768 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2b9121cd-1415-4e2e-9164-b48c4a8511ea tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:06.691217 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2b9121cd-1415-4e2e-9164-b48c4a8511ea tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:06.691939 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2b9121cd-1415-4e2e-9164-b48c4a8511ea tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:06.692399 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2b9121cd-1415-4e2e-9164-b48c4a8511ea tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:06.692824 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2b9121cd-1415-4e2e-9164-b48c4a8511ea tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:06.848315 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2b9121cd-1415-4e2e-9164-b48c4a8511ea tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:06.857899 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2b9121cd-1415-4e2e-9164-b48c4a8511ea tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.181990 Aug 26 06:22:06.858490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 393/797] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:06 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:07.107168 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-22163834-a415-4de0-a9d9-713875526b06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:07.108266 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-22163834-a415-4de0-a9d9-713875526b06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:07.120469 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22163834-a415-4de0-a9d9-713875526b06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:07.121374 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22163834-a415-4de0-a9d9-713875526b06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:07.122139 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22163834-a415-4de0-a9d9-713875526b06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:07.123662 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22163834-a415-4de0-a9d9-713875526b06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:07.124467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22163834-a415-4de0-a9d9-713875526b06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:07.125436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22163834-a415-4de0-a9d9-713875526b06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:07.203111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-22163834-a415-4de0-a9d9-713875526b06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:07.211901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-22163834-a415-4de0-a9d9-713875526b06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1296 microversion: 2.1 time: 0.113013 Aug 26 06:22:07.212191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 405/798] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:07 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1296 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:07.879153 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f6421e2f-4b92-4229-94a9-dff5246dfef1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:07.879884 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f6421e2f-4b92-4229-94a9-dff5246dfef1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:07.886312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6421e2f-4b92-4229-94a9-dff5246dfef1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:07.886934 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6421e2f-4b92-4229-94a9-dff5246dfef1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:07.887341 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6421e2f-4b92-4229-94a9-dff5246dfef1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:07.888033 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6421e2f-4b92-4229-94a9-dff5246dfef1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:07.888491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6421e2f-4b92-4229-94a9-dff5246dfef1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:07.888911 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f6421e2f-4b92-4229-94a9-dff5246dfef1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:08.093603 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f6421e2f-4b92-4229-94a9-dff5246dfef1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:08.103967 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f6421e2f-4b92-4229-94a9-dff5246dfef1 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.228730 Aug 26 06:22:08.104557 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 394/799] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:07 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:08.233633 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-50d4a1a7-63b4-43c0-ab15-3f7eb906b36e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:08.244060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-50d4a1a7-63b4-43c0-ab15-3f7eb906b36e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:08.244060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:08.246270 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50d4a1a7-63b4-43c0-ab15-3f7eb906b36e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:08.246736 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50d4a1a7-63b4-43c0-ab15-3f7eb906b36e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:08.247180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50d4a1a7-63b4-43c0-ab15-3f7eb906b36e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:08.247918 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50d4a1a7-63b4-43c0-ab15-3f7eb906b36e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:08.248374 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50d4a1a7-63b4-43c0-ab15-3f7eb906b36e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:08.248813 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-50d4a1a7-63b4-43c0-ab15-3f7eb906b36e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:08.401085 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-50d4a1a7-63b4-43c0-ab15-3f7eb906b36e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:08.409127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-50d4a1a7-63b4-43c0-ab15-3f7eb906b36e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.179514 Aug 26 06:22:08.409812 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 406/800] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:08 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:09.126782 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7783ff72-af5d-42c9-b175-94c80e436436 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:09.127482 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7783ff72-af5d-42c9-b175-94c80e436436 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:09.134113 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7783ff72-af5d-42c9-b175-94c80e436436 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:09.134594 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7783ff72-af5d-42c9-b175-94c80e436436 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:09.135062 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7783ff72-af5d-42c9-b175-94c80e436436 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:09.135762 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7783ff72-af5d-42c9-b175-94c80e436436 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:09.136218 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7783ff72-af5d-42c9-b175-94c80e436436 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:09.136648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7783ff72-af5d-42c9-b175-94c80e436436 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:09.292697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7783ff72-af5d-42c9-b175-94c80e436436 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:09.301533 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7783ff72-af5d-42c9-b175-94c80e436436 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.178668 Aug 26 06:22:09.302143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 395/801] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:09 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:09.431485 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-292c2eef-751e-4aea-9906-a61e8dc5f9ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:09.432083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-292c2eef-751e-4aea-9906-a61e8dc5f9ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:09.439022 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-292c2eef-751e-4aea-9906-a61e8dc5f9ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:09.439510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-292c2eef-751e-4aea-9906-a61e8dc5f9ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:09.440017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-292c2eef-751e-4aea-9906-a61e8dc5f9ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:09.440745 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-292c2eef-751e-4aea-9906-a61e8dc5f9ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:09.441210 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-292c2eef-751e-4aea-9906-a61e8dc5f9ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:09.441635 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-292c2eef-751e-4aea-9906-a61e8dc5f9ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:09.585692 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-292c2eef-751e-4aea-9906-a61e8dc5f9ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:09.594078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-292c2eef-751e-4aea-9906-a61e8dc5f9ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.166597 Aug 26 06:22:09.597015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 407/802] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:09 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:10.324035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2442a781-7a3b-45e8-a064-badcbda13d2f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:10.324717 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2442a781-7a3b-45e8-a064-badcbda13d2f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:10.332485 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2442a781-7a3b-45e8-a064-badcbda13d2f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:10.334905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2442a781-7a3b-45e8-a064-badcbda13d2f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:10.334905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2442a781-7a3b-45e8-a064-badcbda13d2f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:10.334905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2442a781-7a3b-45e8-a064-badcbda13d2f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:10.334905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2442a781-7a3b-45e8-a064-badcbda13d2f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:10.335527 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2442a781-7a3b-45e8-a064-badcbda13d2f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:10.594744 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2442a781-7a3b-45e8-a064-badcbda13d2f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:10.605187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2442a781-7a3b-45e8-a064-badcbda13d2f tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.284956 Aug 26 06:22:10.614275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 396/803] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:10 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:10.620261 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f54f7a3a-6df6-49e0-ac0c-b95a26b0b8dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:10.620884 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f54f7a3a-6df6-49e0-ac0c-b95a26b0b8dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:10.629083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f54f7a3a-6df6-49e0-ac0c-b95a26b0b8dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:10.629963 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f54f7a3a-6df6-49e0-ac0c-b95a26b0b8dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:10.630570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f54f7a3a-6df6-49e0-ac0c-b95a26b0b8dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:10.631398 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f54f7a3a-6df6-49e0-ac0c-b95a26b0b8dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:10.631882 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f54f7a3a-6df6-49e0-ac0c-b95a26b0b8dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:10.632313 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f54f7a3a-6df6-49e0-ac0c-b95a26b0b8dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:10.844687 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f54f7a3a-6df6-49e0-ac0c-b95a26b0b8dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:10.857502 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f54f7a3a-6df6-49e0-ac0c-b95a26b0b8dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.241942 Aug 26 06:22:10.858569 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 408/804] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:10 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:11.557605 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-a431b68e-1631-4aef-a67d-37f61eeb6d96 req-ce9dfabe-b7b0-4e79-9bb3-ce3883f3256c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "718e8607-e647-40b3-aa7d-16d5f5cd577d", "tag": "1c3c5d78-83bd-44bb-94cf-b0a7843f9fc7"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:22:11.567960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a431b68e-1631-4aef-a67d-37f61eeb6d96 req-ce9dfabe-b7b0-4e79-9bb3-ce3883f3256c service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:11.568440 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a431b68e-1631-4aef-a67d-37f61eeb6d96 req-ce9dfabe-b7b0-4e79-9bb3-ce3883f3256c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:11.568875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a431b68e-1631-4aef-a67d-37f61eeb6d96 req-ce9dfabe-b7b0-4e79-9bb3-ce3883f3256c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:11.581729 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-a431b68e-1631-4aef-a67d-37f61eeb6d96 req-ce9dfabe-b7b0-4e79-9bb3-ce3883f3256c service nova] Creating event network-changed:1c3c5d78-83bd-44bb-94cf-b0a7843f9fc7 for instance 718e8607-e647-40b3-aa7d-16d5f5cd577d on hv-cinder-85391 Aug 26 06:22:11.587088 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-a431b68e-1631-4aef-a67d-37f61eeb6d96 req-ce9dfabe-b7b0-4e79-9bb3-ce3883f3256c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171212 Aug 26 06:22:11.587874 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 397/805] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:22:11.629603 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0d851ab1-2987-43ab-a7db-c82a375051ed tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:11.630360 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0d851ab1-2987-43ab-a7db-c82a375051ed tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:11.636548 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d851ab1-2987-43ab-a7db-c82a375051ed tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:11.637067 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d851ab1-2987-43ab-a7db-c82a375051ed tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:11.637490 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d851ab1-2987-43ab-a7db-c82a375051ed tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:11.638193 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d851ab1-2987-43ab-a7db-c82a375051ed tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:11.642510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d851ab1-2987-43ab-a7db-c82a375051ed tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:11.642510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0d851ab1-2987-43ab-a7db-c82a375051ed tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:11.642510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=100 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:11.811734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0d851ab1-2987-43ab-a7db-c82a375051ed tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:11.821160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0d851ab1-2987-43ab-a7db-c82a375051ed tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.196712 Aug 26 06:22:11.821732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 409/806] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:11 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:11.882732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f76a8e9f-e47e-4e7b-8f8b-7ea4a3dcc182 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:11.883586 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f76a8e9f-e47e-4e7b-8f8b-7ea4a3dcc182 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:11.896223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f76a8e9f-e47e-4e7b-8f8b-7ea4a3dcc182 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:11.896223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f76a8e9f-e47e-4e7b-8f8b-7ea4a3dcc182 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:11.896223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f76a8e9f-e47e-4e7b-8f8b-7ea4a3dcc182 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:11.896223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f76a8e9f-e47e-4e7b-8f8b-7ea4a3dcc182 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:11.896813 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f76a8e9f-e47e-4e7b-8f8b-7ea4a3dcc182 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:11.896813 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f76a8e9f-e47e-4e7b-8f8b-7ea4a3dcc182 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:12.074920 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f76a8e9f-e47e-4e7b-8f8b-7ea4a3dcc182 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:12.084012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f76a8e9f-e47e-4e7b-8f8b-7ea4a3dcc182 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.206907 Aug 26 06:22:12.084593 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 398/807] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:11 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:12.842764 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5855b255-2af3-4ebf-a945-0cd4bcbcca49 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:12.843322 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5855b255-2af3-4ebf-a945-0cd4bcbcca49 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:12.851174 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5855b255-2af3-4ebf-a945-0cd4bcbcca49 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:12.851656 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5855b255-2af3-4ebf-a945-0cd4bcbcca49 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:12.852090 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5855b255-2af3-4ebf-a945-0cd4bcbcca49 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:12.852771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5855b255-2af3-4ebf-a945-0cd4bcbcca49 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:12.853213 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5855b255-2af3-4ebf-a945-0cd4bcbcca49 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:12.853631 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5855b255-2af3-4ebf-a945-0cd4bcbcca49 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:13.012931 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5855b255-2af3-4ebf-a945-0cd4bcbcca49 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:13.021938 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5855b255-2af3-4ebf-a945-0cd4bcbcca49 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.183012 Aug 26 06:22:13.022732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 410/808] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:12 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:13.117495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e4e895f0-3ae3-4b21-a1a4-36d72fc3c9c0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:13.117495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e4e895f0-3ae3-4b21-a1a4-36d72fc3c9c0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:13.117495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:13.117495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=10 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:13.121900 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4e895f0-3ae3-4b21-a1a4-36d72fc3c9c0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:13.122435 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4e895f0-3ae3-4b21-a1a4-36d72fc3c9c0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:13.122909 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4e895f0-3ae3-4b21-a1a4-36d72fc3c9c0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:13.123620 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4e895f0-3ae3-4b21-a1a4-36d72fc3c9c0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:13.124133 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4e895f0-3ae3-4b21-a1a4-36d72fc3c9c0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:13.124577 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4e895f0-3ae3-4b21-a1a4-36d72fc3c9c0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:13.355127 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e4e895f0-3ae3-4b21-a1a4-36d72fc3c9c0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:13.365104 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e4e895f0-3ae3-4b21-a1a4-36d72fc3c9c0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.262877 Aug 26 06:22:13.365695 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 399/809] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:13 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:22:14.055408 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-29ba3945-34a8-4e13-9302-cb29e558a7f7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:14.056676 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-29ba3945-34a8-4e13-9302-cb29e558a7f7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:14.059276 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=4 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:14.065766 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29ba3945-34a8-4e13-9302-cb29e558a7f7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:14.066425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29ba3945-34a8-4e13-9302-cb29e558a7f7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:14.066900 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29ba3945-34a8-4e13-9302-cb29e558a7f7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:14.067606 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29ba3945-34a8-4e13-9302-cb29e558a7f7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:14.068064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29ba3945-34a8-4e13-9302-cb29e558a7f7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:14.068503 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29ba3945-34a8-4e13-9302-cb29e558a7f7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:14.220285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-29ba3945-34a8-4e13-9302-cb29e558a7f7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:14.229220 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-29ba3945-34a8-4e13-9302-cb29e558a7f7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.177874 Aug 26 06:22:14.229831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 411/810] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:14 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:14.386382 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9ef2b87c-35b1-4351-9e2a-6489f8c666b9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:14.387127 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9ef2b87c-35b1-4351-9e2a-6489f8c666b9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:14.389364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:14.395455 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9ef2b87c-35b1-4351-9e2a-6489f8c666b9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:14.395938 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9ef2b87c-35b1-4351-9e2a-6489f8c666b9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:14.396367 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9ef2b87c-35b1-4351-9e2a-6489f8c666b9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:14.397060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9ef2b87c-35b1-4351-9e2a-6489f8c666b9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:14.397510 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9ef2b87c-35b1-4351-9e2a-6489f8c666b9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:14.397932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9ef2b87c-35b1-4351-9e2a-6489f8c666b9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:14.543553 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9ef2b87c-35b1-4351-9e2a-6489f8c666b9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:14.553306 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9ef2b87c-35b1-4351-9e2a-6489f8c666b9 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.171460 Aug 26 06:22:14.553885 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 400/811] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:14 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:15.251974 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b47d08e5-1a82-43db-aa3b-a5d4d480bed4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:15.253332 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b47d08e5-1a82-43db-aa3b-a5d4d480bed4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:15.260801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b47d08e5-1a82-43db-aa3b-a5d4d480bed4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:15.261285 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b47d08e5-1a82-43db-aa3b-a5d4d480bed4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:15.261723 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b47d08e5-1a82-43db-aa3b-a5d4d480bed4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:15.262413 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b47d08e5-1a82-43db-aa3b-a5d4d480bed4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:15.262906 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b47d08e5-1a82-43db-aa3b-a5d4d480bed4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:15.263332 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b47d08e5-1a82-43db-aa3b-a5d4d480bed4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:15.414554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b47d08e5-1a82-43db-aa3b-a5d4d480bed4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:15.427341 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b47d08e5-1a82-43db-aa3b-a5d4d480bed4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.179176 Aug 26 06:22:15.427917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 412/812] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:15 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:15.575267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-52b1ee29-46b9-4f77-80eb-6e515b673eb0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:15.575881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-52b1ee29-46b9-4f77-80eb-6e515b673eb0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:15.582402 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-52b1ee29-46b9-4f77-80eb-6e515b673eb0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:15.582925 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-52b1ee29-46b9-4f77-80eb-6e515b673eb0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:15.583372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-52b1ee29-46b9-4f77-80eb-6e515b673eb0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:15.584084 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-52b1ee29-46b9-4f77-80eb-6e515b673eb0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:15.584531 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-52b1ee29-46b9-4f77-80eb-6e515b673eb0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:15.584951 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-52b1ee29-46b9-4f77-80eb-6e515b673eb0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:15.718005 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-52b1ee29-46b9-4f77-80eb-6e515b673eb0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:15.726135 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-52b1ee29-46b9-4f77-80eb-6e515b673eb0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.154840 Aug 26 06:22:15.727044 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 401/813] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:15 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:16.449663 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8afebeda-5ac3-44a8-922a-2b4ba563acce tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:16.450961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8afebeda-5ac3-44a8-922a-2b4ba563acce tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:16.458492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8afebeda-5ac3-44a8-922a-2b4ba563acce tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:16.459022 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8afebeda-5ac3-44a8-922a-2b4ba563acce tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:16.459462 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8afebeda-5ac3-44a8-922a-2b4ba563acce tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:16.460164 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8afebeda-5ac3-44a8-922a-2b4ba563acce tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:16.460646 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8afebeda-5ac3-44a8-922a-2b4ba563acce tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:16.461064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8afebeda-5ac3-44a8-922a-2b4ba563acce tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:16.610921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8afebeda-5ac3-44a8-922a-2b4ba563acce tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:16.619697 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8afebeda-5ac3-44a8-922a-2b4ba563acce tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1758 microversion: 2.1 time: 0.173768 Aug 26 06:22:16.620419 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 413/814] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:16 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:16.747633 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-258c893a-7125-4b67-a6da-1c4dd5c6a439 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:16.748383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-258c893a-7125-4b67-a6da-1c4dd5c6a439 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:16.755926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-258c893a-7125-4b67-a6da-1c4dd5c6a439 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:16.756413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-258c893a-7125-4b67-a6da-1c4dd5c6a439 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:16.756846 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-258c893a-7125-4b67-a6da-1c4dd5c6a439 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:16.757534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-258c893a-7125-4b67-a6da-1c4dd5c6a439 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:16.758000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-258c893a-7125-4b67-a6da-1c4dd5c6a439 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:16.758415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-258c893a-7125-4b67-a6da-1c4dd5c6a439 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:16.935286 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-258c893a-7125-4b67-a6da-1c4dd5c6a439 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:16.945639 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-258c893a-7125-4b67-a6da-1c4dd5c6a439 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.201389 Aug 26 06:22:16.946760 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 402/815] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:16 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:17.644881 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6ec81ef8-6f2e-4cc0-8431-54acc2e668c7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:17.645598 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6ec81ef8-6f2e-4cc0-8431-54acc2e668c7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:17.652492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6ec81ef8-6f2e-4cc0-8431-54acc2e668c7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:17.653872 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6ec81ef8-6f2e-4cc0-8431-54acc2e668c7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:17.653872 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6ec81ef8-6f2e-4cc0-8431-54acc2e668c7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:17.654791 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6ec81ef8-6f2e-4cc0-8431-54acc2e668c7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:17.654791 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6ec81ef8-6f2e-4cc0-8431-54acc2e668c7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:17.654963 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6ec81ef8-6f2e-4cc0-8431-54acc2e668c7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:17.811401 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6ec81ef8-6f2e-4cc0-8431-54acc2e668c7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:17.820761 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6ec81ef8-6f2e-4cc0-8431-54acc2e668c7 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1761 microversion: 2.1 time: 0.180887 Aug 26 06:22:17.821304 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 414/816] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:17 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1761 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:22:17.975667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8e683c59-b65f-4c38-9b5e-a053c6640790 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:17.976668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8e683c59-b65f-4c38-9b5e-a053c6640790 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:17.984532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e683c59-b65f-4c38-9b5e-a053c6640790 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:17.985098 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e683c59-b65f-4c38-9b5e-a053c6640790 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:17.985606 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e683c59-b65f-4c38-9b5e-a053c6640790 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:17.986300 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e683c59-b65f-4c38-9b5e-a053c6640790 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:17.987305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e683c59-b65f-4c38-9b5e-a053c6640790 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:17.988077 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e683c59-b65f-4c38-9b5e-a053c6640790 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:18.124287 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8e683c59-b65f-4c38-9b5e-a053c6640790 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:18.132731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8e683c59-b65f-4c38-9b5e-a053c6640790 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.162693 Aug 26 06:22:18.133333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 403/817] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:17 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:19.153377 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0577aa7e-99f2-4eda-8ed0-5daa7e63470e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:19.154002 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0577aa7e-99f2-4eda-8ed0-5daa7e63470e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:19.161710 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0577aa7e-99f2-4eda-8ed0-5daa7e63470e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:19.162191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0577aa7e-99f2-4eda-8ed0-5daa7e63470e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:19.162711 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0577aa7e-99f2-4eda-8ed0-5daa7e63470e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:19.165609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0577aa7e-99f2-4eda-8ed0-5daa7e63470e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:19.165609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0577aa7e-99f2-4eda-8ed0-5daa7e63470e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:19.165609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0577aa7e-99f2-4eda-8ed0-5daa7e63470e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:19.300492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0577aa7e-99f2-4eda-8ed0-5daa7e63470e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:19.308241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0577aa7e-99f2-4eda-8ed0-5daa7e63470e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.158702 Aug 26 06:22:19.308824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 415/818] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:19 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:20.194671 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-c6bcd7a1-ced3-4597-a129-68913a2916bb req-b19c3b5e-b4b3-482a-a9d5-b66e6d727986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718e8607-e647-40b3-aa7d-16d5f5cd577d", "name": "network-vif-plugged", "status": "completed", "tag": "1c3c5d78-83bd-44bb-94cf-b0a7843f9fc7"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:22:20.206001 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c6bcd7a1-ced3-4597-a129-68913a2916bb req-b19c3b5e-b4b3-482a-a9d5-b66e6d727986 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:20.206597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c6bcd7a1-ced3-4597-a129-68913a2916bb req-b19c3b5e-b4b3-482a-a9d5-b66e6d727986 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:20.207063 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c6bcd7a1-ced3-4597-a129-68913a2916bb req-b19c3b5e-b4b3-482a-a9d5-b66e6d727986 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:20.225227 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-c6bcd7a1-ced3-4597-a129-68913a2916bb req-b19c3b5e-b4b3-482a-a9d5-b66e6d727986 service nova] Creating event network-vif-plugged:1c3c5d78-83bd-44bb-94cf-b0a7843f9fc7 for instance 718e8607-e647-40b3-aa7d-16d5f5cd577d on hv-cinder-85391 Aug 26 06:22:20.230332 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-c6bcd7a1-ced3-4597-a129-68913a2916bb req-b19c3b5e-b4b3-482a-a9d5-b66e6d727986 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112409 Aug 26 06:22:20.232352 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 404/819] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:22:20.329725 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-80cea7b8-88df-4eac-a007-37c8f0e29b39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:20.330294 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-80cea7b8-88df-4eac-a007-37c8f0e29b39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:20.336941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-80cea7b8-88df-4eac-a007-37c8f0e29b39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:20.337461 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-80cea7b8-88df-4eac-a007-37c8f0e29b39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:20.337850 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-80cea7b8-88df-4eac-a007-37c8f0e29b39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:20.338543 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-80cea7b8-88df-4eac-a007-37c8f0e29b39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:20.339025 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-80cea7b8-88df-4eac-a007-37c8f0e29b39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:20.339448 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-80cea7b8-88df-4eac-a007-37c8f0e29b39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:20.494424 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-80cea7b8-88df-4eac-a007-37c8f0e29b39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:20.502954 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-80cea7b8-88df-4eac-a007-37c8f0e29b39 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.177181 Aug 26 06:22:20.503524 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 416/820] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:20 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:22:21.525928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f101b6cf-f6f6-494a-9557-cb8ef82ccbf7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:21.526656 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f101b6cf-f6f6-494a-9557-cb8ef82ccbf7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:21.533235 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f101b6cf-f6f6-494a-9557-cb8ef82ccbf7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:21.534300 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f101b6cf-f6f6-494a-9557-cb8ef82ccbf7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:21.534865 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f101b6cf-f6f6-494a-9557-cb8ef82ccbf7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:21.535514 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f101b6cf-f6f6-494a-9557-cb8ef82ccbf7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:21.535972 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f101b6cf-f6f6-494a-9557-cb8ef82ccbf7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:21.536401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f101b6cf-f6f6-494a-9557-cb8ef82ccbf7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:21.705757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f101b6cf-f6f6-494a-9557-cb8ef82ccbf7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:21.719666 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f101b6cf-f6f6-494a-9557-cb8ef82ccbf7 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.193396 Aug 26 06:22:21.719666 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 405/821] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:21 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:22.748982 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0e926baa-5f95-4407-9164-a23ac055df91 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:22.749854 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0e926baa-5f95-4407-9164-a23ac055df91 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:22.759819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0e926baa-5f95-4407-9164-a23ac055df91 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:22.760498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0e926baa-5f95-4407-9164-a23ac055df91 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:22.761012 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0e926baa-5f95-4407-9164-a23ac055df91 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:22.761845 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0e926baa-5f95-4407-9164-a23ac055df91 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:22.762356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0e926baa-5f95-4407-9164-a23ac055df91 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:22.762878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0e926baa-5f95-4407-9164-a23ac055df91 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:22.911842 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0e926baa-5f95-4407-9164-a23ac055df91 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:22.924595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0e926baa-5f95-4407-9164-a23ac055df91 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.180926 Aug 26 06:22:22.925355 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 417/822] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:22 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:23.946685 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3328a977-c456-4796-b8b6-bc22447892ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:23.947296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3328a977-c456-4796-b8b6-bc22447892ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:23.954052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3328a977-c456-4796-b8b6-bc22447892ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:23.962775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3328a977-c456-4796-b8b6-bc22447892ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:23.962775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3328a977-c456-4796-b8b6-bc22447892ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:23.962775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3328a977-c456-4796-b8b6-bc22447892ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:23.962775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3328a977-c456-4796-b8b6-bc22447892ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:23.963180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3328a977-c456-4796-b8b6-bc22447892ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:24.113433 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3328a977-c456-4796-b8b6-bc22447892ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:24.117246 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:24.121910 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3328a977-c456-4796-b8b6-bc22447892ee tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.179362 Aug 26 06:22:24.122485 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 406/823] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:23 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:25.143563 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c0cc87fc-b886-449f-8634-f4a67c15b2f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:25.144181 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c0cc87fc-b886-449f-8634-f4a67c15b2f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:25.150762 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0cc87fc-b886-449f-8634-f4a67c15b2f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:25.151244 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0cc87fc-b886-449f-8634-f4a67c15b2f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:25.151683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0cc87fc-b886-449f-8634-f4a67c15b2f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:25.152381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0cc87fc-b886-449f-8634-f4a67c15b2f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:25.152835 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0cc87fc-b886-449f-8634-f4a67c15b2f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:25.153334 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0cc87fc-b886-449f-8634-f4a67c15b2f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:25.309890 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c0cc87fc-b886-449f-8634-f4a67c15b2f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:25.322500 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c0cc87fc-b886-449f-8634-f4a67c15b2f6 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1361 microversion: 2.1 time: 0.182508 Aug 26 06:22:25.331713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 418/824] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:25 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:26.345504 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-eeaeff58-8bed-47f3-b8ad-f77f278578fc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:26.346159 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-eeaeff58-8bed-47f3-b8ad-f77f278578fc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:26.353349 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eeaeff58-8bed-47f3-b8ad-f77f278578fc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:26.360834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eeaeff58-8bed-47f3-b8ad-f77f278578fc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:26.360834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eeaeff58-8bed-47f3-b8ad-f77f278578fc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:26.360834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eeaeff58-8bed-47f3-b8ad-f77f278578fc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:26.360834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eeaeff58-8bed-47f3-b8ad-f77f278578fc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:26.361225 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-eeaeff58-8bed-47f3-b8ad-f77f278578fc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:26.500548 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-eeaeff58-8bed-47f3-b8ad-f77f278578fc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:26.509209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-eeaeff58-8bed-47f3-b8ad-f77f278578fc tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1547 microversion: 2.1 time: 0.167676 Aug 26 06:22:26.509800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 407/825] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:26 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:22:26.532706 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b7f4dac0-0241-4f5a-83b0-67eb39595408 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:26.533362 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b7f4dac0-0241-4f5a-83b0-67eb39595408 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:26.540759 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7f4dac0-0241-4f5a-83b0-67eb39595408 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:26.541236 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7f4dac0-0241-4f5a-83b0-67eb39595408 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:26.541666 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7f4dac0-0241-4f5a-83b0-67eb39595408 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:26.542395 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7f4dac0-0241-4f5a-83b0-67eb39595408 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:26.542969 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7f4dac0-0241-4f5a-83b0-67eb39595408 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:26.543394 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7f4dac0-0241-4f5a-83b0-67eb39595408 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:26.628484 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b7f4dac0-0241-4f5a-83b0-67eb39595408 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099643 Aug 26 06:22:26.629077 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 419/826] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 06:22:26 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:22:27.889770 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-6bd3b546-3f2a-4961-b38a-4222fc8cccb1 req-86a968e2-f1f6-47d0-8413-6539c0065998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "718e8607-e647-40b3-aa7d-16d5f5cd577d", "tag": "1c3c5d78-83bd-44bb-94cf-b0a7843f9fc7"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:22:27.901011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-6bd3b546-3f2a-4961-b38a-4222fc8cccb1 req-86a968e2-f1f6-47d0-8413-6539c0065998 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:27.901532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-6bd3b546-3f2a-4961-b38a-4222fc8cccb1 req-86a968e2-f1f6-47d0-8413-6539c0065998 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:27.902054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-6bd3b546-3f2a-4961-b38a-4222fc8cccb1 req-86a968e2-f1f6-47d0-8413-6539c0065998 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:27.915967 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-6bd3b546-3f2a-4961-b38a-4222fc8cccb1 req-86a968e2-f1f6-47d0-8413-6539c0065998 service nova] Creating event network-changed:1c3c5d78-83bd-44bb-94cf-b0a7843f9fc7 for instance 718e8607-e647-40b3-aa7d-16d5f5cd577d on hv-cinder-85391 Aug 26 06:22:27.921987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-6bd3b546-3f2a-4961-b38a-4222fc8cccb1 req-86a968e2-f1f6-47d0-8413-6539c0065998 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111326 Aug 26 06:22:27.922734 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 408/827] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:22:41.430323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=27 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:41.431268 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=63 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:41.435748 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-2fceb6b2-cf79-49a1-b138-0a7e078d5b29 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:41.436246 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-2fceb6b2-cf79-49a1-b138-0a7e078d5b29 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:41.442220 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2fceb6b2-cf79-49a1-b138-0a7e078d5b29 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:41.442734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2fceb6b2-cf79-49a1-b138-0a7e078d5b29 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:41.443171 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2fceb6b2-cf79-49a1-b138-0a7e078d5b29 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:41.443872 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2fceb6b2-cf79-49a1-b138-0a7e078d5b29 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:41.444324 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2fceb6b2-cf79-49a1-b138-0a7e078d5b29 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:41.444754 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2fceb6b2-cf79-49a1-b138-0a7e078d5b29 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:41.535578 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-2fceb6b2-cf79-49a1-b138-0a7e078d5b29 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lazy-loading 'services' on Instance uuid 45330505-4b58-4762-bb9f-e704f9648e1e {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:22:41.870692 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-2fceb6b2-cf79-49a1-b138-0a7e078d5b29 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "DELETE /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments/1ea527f3-b73c-471a-8c87-dce4881165cd" status: 202 len: 0 microversion: 2.1 time: 0.442160 Aug 26 06:22:41.871315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 420/828] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:22:41 2022] DELETE /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments/1ea527f3-b73c-471a-8c87-dce4881165cd => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:22:41.878077 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=17 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:41.879670 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=8 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:41.888218 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-bc531510-b88b-4940-833b-d6d9598c4df1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:41.890981 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-bc531510-b88b-4940-833b-d6d9598c4df1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:41.899057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc531510-b88b-4940-833b-d6d9598c4df1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:41.899771 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc531510-b88b-4940-833b-d6d9598c4df1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:41.900207 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc531510-b88b-4940-833b-d6d9598c4df1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:41.900908 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc531510-b88b-4940-833b-d6d9598c4df1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:41.901840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc531510-b88b-4940-833b-d6d9598c4df1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:41.902040 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bc531510-b88b-4940-833b-d6d9598c4df1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:41.938563 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-bc531510-b88b-4940-833b-d6d9598c4df1 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062558 Aug 26 06:22:41.939243 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 409/829] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:22:41 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:22:42.953447 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5051959a-dc06-4696-b845-2c2620edfed6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:42.956166 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5051959a-dc06-4696-b845-2c2620edfed6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:42.963382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5051959a-dc06-4696-b845-2c2620edfed6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:42.963878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5051959a-dc06-4696-b845-2c2620edfed6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:42.964324 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5051959a-dc06-4696-b845-2c2620edfed6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:42.965035 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5051959a-dc06-4696-b845-2c2620edfed6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:42.965492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5051959a-dc06-4696-b845-2c2620edfed6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:42.965919 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5051959a-dc06-4696-b845-2c2620edfed6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:43.001120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5051959a-dc06-4696-b845-2c2620edfed6 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052500 Aug 26 06:22:43.001782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 421/830] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:22:42 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:22:43.588314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e1922517-ab51-4c14-8729-5a19bca4bc5e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:43.588866 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e1922517-ab51-4c14-8729-5a19bca4bc5e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:43.596914 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e1922517-ab51-4c14-8729-5a19bca4bc5e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:43.597468 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e1922517-ab51-4c14-8729-5a19bca4bc5e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:43.597905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e1922517-ab51-4c14-8729-5a19bca4bc5e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:43.598654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e1922517-ab51-4c14-8729-5a19bca4bc5e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:43.599094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e1922517-ab51-4c14-8729-5a19bca4bc5e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:43.599701 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e1922517-ab51-4c14-8729-5a19bca4bc5e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:43.634444 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e1922517-ab51-4c14-8729-5a19bca4bc5e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments/70061d04-8cee-4a69-8adf-55f2b1a5e1b2" status: 200 len: 194 microversion: 2.20 time: 0.050590 Aug 26 06:22:43.635079 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 410/831] 10.222.0.40 () {60 vars in 1454 bytes} [Fri Aug 26 06:22:43 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments/70061d04-8cee-4a69-8adf-55f2b1a5e1b2 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:22:43.710250 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-97d58f35-6872-4e6d-8d49-7cc30f87510e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:43.710779 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-97d58f35-6872-4e6d-8d49-7cc30f87510e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:43.717200 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97d58f35-6872-4e6d-8d49-7cc30f87510e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:43.717807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97d58f35-6872-4e6d-8d49-7cc30f87510e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:43.718248 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97d58f35-6872-4e6d-8d49-7cc30f87510e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:43.718981 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97d58f35-6872-4e6d-8d49-7cc30f87510e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:43.719439 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97d58f35-6872-4e6d-8d49-7cc30f87510e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:43.719871 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97d58f35-6872-4e6d-8d49-7cc30f87510e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:43.809925 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-97d58f35-6872-4e6d-8d49-7cc30f87510e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lazy-loading 'services' on Instance uuid ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:22:44.013805 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b680464e-6314-415d-afe2-b25c1f981432 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:44.016084 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b680464e-6314-415d-afe2-b25c1f981432 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:44.022574 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b680464e-6314-415d-afe2-b25c1f981432 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:44.023089 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b680464e-6314-415d-afe2-b25c1f981432 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:44.023520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b680464e-6314-415d-afe2-b25c1f981432 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:44.024212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b680464e-6314-415d-afe2-b25c1f981432 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:44.024651 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b680464e-6314-415d-afe2-b25c1f981432 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:44.025071 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b680464e-6314-415d-afe2-b25c1f981432 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:44.054964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b680464e-6314-415d-afe2-b25c1f981432 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045591 Aug 26 06:22:44.055524 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 411/832] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:22:44 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 06:22:44.147059 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e4a54827-afe2-4e37-b94c-85a5c20a1e0e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:44.147558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e4a54827-afe2-4e37-b94c-85a5c20a1e0e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:44.153499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4a54827-afe2-4e37-b94c-85a5c20a1e0e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:44.153984 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4a54827-afe2-4e37-b94c-85a5c20a1e0e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:44.154422 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4a54827-afe2-4e37-b94c-85a5c20a1e0e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:44.155149 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4a54827-afe2-4e37-b94c-85a5c20a1e0e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:44.155605 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4a54827-afe2-4e37-b94c-85a5c20a1e0e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:44.156030 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e4a54827-afe2-4e37-b94c-85a5c20a1e0e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:44.183711 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e4a54827-afe2-4e37-b94c-85a5c20a1e0e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:22:44.235531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-97d58f35-6872-4e6d-8d49-7cc30f87510e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments/70061d04-8cee-4a69-8adf-55f2b1a5e1b2" status: 202 len: 0 microversion: 2.20 time: 0.530722 Aug 26 06:22:44.236239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 422/833] 10.222.0.40 () {60 vars in 1457 bytes} [Fri Aug 26 06:22:43 2022] DELETE /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments/70061d04-8cee-4a69-8adf-55f2b1a5e1b2 => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:22:44.245892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-42fc765f-c2c1-4f6e-adc9-d8b7e438edb8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:44.248299 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-42fc765f-c2c1-4f6e-adc9-d8b7e438edb8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:44.255729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42fc765f-c2c1-4f6e-adc9-d8b7e438edb8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:44.256203 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42fc765f-c2c1-4f6e-adc9-d8b7e438edb8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:44.256725 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42fc765f-c2c1-4f6e-adc9-d8b7e438edb8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:44.257342 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42fc765f-c2c1-4f6e-adc9-d8b7e438edb8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:44.257786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42fc765f-c2c1-4f6e-adc9-d8b7e438edb8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:44.258204 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-42fc765f-c2c1-4f6e-adc9-d8b7e438edb8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:44.290231 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-42fc765f-c2c1-4f6e-adc9-d8b7e438edb8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048637 Aug 26 06:22:44.290805 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 423/834] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 06:22:44 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:22:44.813336 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e4a54827-afe2-4e37-b94c-85a5c20a1e0e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "DELETE /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 204 len: 0 microversion: 2.1 time: 0.671147 Aug 26 06:22:44.820223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 412/835] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:22:44 2022] DELETE /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 0 bytes in 673 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 06:22:44.822545 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4c7a12f4-f0e0-48a4-877c-3a77fe73e39a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:44.823118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4c7a12f4-f0e0-48a4-877c-3a77fe73e39a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:44.829515 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4c7a12f4-f0e0-48a4-877c-3a77fe73e39a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:44.830589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4c7a12f4-f0e0-48a4-877c-3a77fe73e39a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:44.831086 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4c7a12f4-f0e0-48a4-877c-3a77fe73e39a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:44.831872 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4c7a12f4-f0e0-48a4-877c-3a77fe73e39a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:44.832312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4c7a12f4-f0e0-48a4-877c-3a77fe73e39a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:44.832744 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4c7a12f4-f0e0-48a4-877c-3a77fe73e39a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:44.977042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4c7a12f4-f0e0-48a4-877c-3a77fe73e39a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:44.984982 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4c7a12f4-f0e0-48a4-877c-3a77fe73e39a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1688 microversion: 2.1 time: 0.166613 Aug 26 06:22:44.985532 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 424/836] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:44 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:45.309790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-984945e8-cd24-45e6-8c67-672addfca412 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:45.312038 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-984945e8-cd24-45e6-8c67-672addfca412 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:45.321860 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-984945e8-cd24-45e6-8c67-672addfca412 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:45.332292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-984945e8-cd24-45e6-8c67-672addfca412 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:45.332292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-984945e8-cd24-45e6-8c67-672addfca412 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:45.332292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-984945e8-cd24-45e6-8c67-672addfca412 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:45.332292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-984945e8-cd24-45e6-8c67-672addfca412 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:45.332629 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-984945e8-cd24-45e6-8c67-672addfca412 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:45.358607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-984945e8-cd24-45e6-8c67-672addfca412 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053540 Aug 26 06:22:45.359340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 413/837] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 06:22:45 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:22:46.005247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b39fe3e0-4fd9-4ba9-8bbd-7ff0d4a4e8ca tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:46.005840 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b39fe3e0-4fd9-4ba9-8bbd-7ff0d4a4e8ca tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:46.012310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39fe3e0-4fd9-4ba9-8bbd-7ff0d4a4e8ca tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:46.012796 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39fe3e0-4fd9-4ba9-8bbd-7ff0d4a4e8ca tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:46.013224 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39fe3e0-4fd9-4ba9-8bbd-7ff0d4a4e8ca tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:46.013904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39fe3e0-4fd9-4ba9-8bbd-7ff0d4a4e8ca tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:46.014349 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39fe3e0-4fd9-4ba9-8bbd-7ff0d4a4e8ca tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:46.014820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b39fe3e0-4fd9-4ba9-8bbd-7ff0d4a4e8ca tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:46.148348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b39fe3e0-4fd9-4ba9-8bbd-7ff0d4a4e8ca tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:46.156184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b39fe3e0-4fd9-4ba9-8bbd-7ff0d4a4e8ca tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1688 microversion: 2.1 time: 0.154891 Aug 26 06:22:46.156793 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 425/838] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:46 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:46.372675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-bd43b7bd-ba91-41af-98f1-b23ebc6a5da5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:46.374871 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-bd43b7bd-ba91-41af-98f1-b23ebc6a5da5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:46.381513 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd43b7bd-ba91-41af-98f1-b23ebc6a5da5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:46.381998 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd43b7bd-ba91-41af-98f1-b23ebc6a5da5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:46.382433 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd43b7bd-ba91-41af-98f1-b23ebc6a5da5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:46.383160 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd43b7bd-ba91-41af-98f1-b23ebc6a5da5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:46.383618 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd43b7bd-ba91-41af-98f1-b23ebc6a5da5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:46.384043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd43b7bd-ba91-41af-98f1-b23ebc6a5da5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:46.416322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-bd43b7bd-ba91-41af-98f1-b23ebc6a5da5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047621 Aug 26 06:22:46.416888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 414/839] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 06:22:46 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 06:22:47.178180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c546b834-d154-454b-a7fb-f2b5de99da03 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:47.178817 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c546b834-d154-454b-a7fb-f2b5de99da03 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:47.185236 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c546b834-d154-454b-a7fb-f2b5de99da03 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:47.185718 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c546b834-d154-454b-a7fb-f2b5de99da03 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:47.186153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c546b834-d154-454b-a7fb-f2b5de99da03 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:47.186871 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c546b834-d154-454b-a7fb-f2b5de99da03 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:47.187323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c546b834-d154-454b-a7fb-f2b5de99da03 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:47.187743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c546b834-d154-454b-a7fb-f2b5de99da03 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:47.327044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c546b834-d154-454b-a7fb-f2b5de99da03 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:47.335512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c546b834-d154-454b-a7fb-f2b5de99da03 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1688 microversion: 2.1 time: 0.162042 Aug 26 06:22:47.336081 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 426/840] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:47 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:47.429922 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d99de489-355b-4311-8ed7-c1aac2807944 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:47.439611 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d99de489-355b-4311-8ed7-c1aac2807944 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:47.439611 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d99de489-355b-4311-8ed7-c1aac2807944 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:47.439891 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d99de489-355b-4311-8ed7-c1aac2807944 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:47.440337 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d99de489-355b-4311-8ed7-c1aac2807944 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:47.441053 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d99de489-355b-4311-8ed7-c1aac2807944 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:47.441490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d99de489-355b-4311-8ed7-c1aac2807944 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:47.441913 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d99de489-355b-4311-8ed7-c1aac2807944 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:47.474258 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d99de489-355b-4311-8ed7-c1aac2807944 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048320 Aug 26 06:22:47.474908 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 415/841] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 06:22:47 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:22:48.367921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cc63bcd2-af95-412d-beeb-99166e84a41a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:48.368649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-cc63bcd2-af95-412d-beeb-99166e84a41a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:48.374786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cc63bcd2-af95-412d-beeb-99166e84a41a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:48.375265 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cc63bcd2-af95-412d-beeb-99166e84a41a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:48.375700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cc63bcd2-af95-412d-beeb-99166e84a41a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:48.376388 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cc63bcd2-af95-412d-beeb-99166e84a41a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:48.377001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cc63bcd2-af95-412d-beeb-99166e84a41a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:48.377436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cc63bcd2-af95-412d-beeb-99166e84a41a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:48.489681 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7d0d04e9-ecf0-458a-866f-75a802751f71 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:48.491935 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7d0d04e9-ecf0-458a-866f-75a802751f71 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:48.499094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d0d04e9-ecf0-458a-866f-75a802751f71 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:48.503313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d0d04e9-ecf0-458a-866f-75a802751f71 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:48.503313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d0d04e9-ecf0-458a-866f-75a802751f71 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:48.503313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d0d04e9-ecf0-458a-866f-75a802751f71 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:48.503313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d0d04e9-ecf0-458a-866f-75a802751f71 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:48.503728 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7d0d04e9-ecf0-458a-866f-75a802751f71 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:48.524118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cc63bcd2-af95-412d-beeb-99166e84a41a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:48.532086 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cc63bcd2-af95-412d-beeb-99166e84a41a tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1688 microversion: 2.1 time: 0.170380 Aug 26 06:22:48.532660 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 427/842] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:48 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:48.534907 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7d0d04e9-ecf0-458a-866f-75a802751f71 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051778 Aug 26 06:22:48.535300 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 416/843] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 06:22:48 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 06:22:49.547157 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-928fc502-0ee8-4985-a758-112c2c668ee8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:49.551213 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-928fc502-0ee8-4985-a758-112c2c668ee8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:49.558553 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-928fc502-0ee8-4985-a758-112c2c668ee8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:49.559382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-928fc502-0ee8-4985-a758-112c2c668ee8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:49.559715 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-928fc502-0ee8-4985-a758-112c2c668ee8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:49.560673 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-928fc502-0ee8-4985-a758-112c2c668ee8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:49.561297 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-928fc502-0ee8-4985-a758-112c2c668ee8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:49.561727 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-928fc502-0ee8-4985-a758-112c2c668ee8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:49.563885 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8cec11fd-73f2-4cb4-9f45-5fcd39ded159 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:49.564842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8cec11fd-73f2-4cb4-9f45-5fcd39ded159 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:49.581475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cec11fd-73f2-4cb4-9f45-5fcd39ded159 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:49.582004 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cec11fd-73f2-4cb4-9f45-5fcd39ded159 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:49.582453 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cec11fd-73f2-4cb4-9f45-5fcd39ded159 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:49.583209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cec11fd-73f2-4cb4-9f45-5fcd39ded159 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:49.583664 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cec11fd-73f2-4cb4-9f45-5fcd39ded159 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:49.584394 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cec11fd-73f2-4cb4-9f45-5fcd39ded159 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:49.596672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-928fc502-0ee8-4985-a758-112c2c668ee8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053724 Aug 26 06:22:49.597502 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 428/844] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 06:22:49 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:49.666190 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e6d5107d-2fd1-4afd-b388-c42029eca0e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:49.666878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e6d5107d-2fd1-4afd-b388-c42029eca0e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:49.673079 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e6d5107d-2fd1-4afd-b388-c42029eca0e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:49.674448 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e6d5107d-2fd1-4afd-b388-c42029eca0e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:49.675282 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e6d5107d-2fd1-4afd-b388-c42029eca0e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:49.681892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e6d5107d-2fd1-4afd-b388-c42029eca0e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:49.681892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e6d5107d-2fd1-4afd-b388-c42029eca0e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:49.681892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e6d5107d-2fd1-4afd-b388-c42029eca0e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:49.688757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8cec11fd-73f2-4cb4-9f45-5fcd39ded159 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:49.697150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8cec11fd-73f2-4cb4-9f45-5fcd39ded159 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1620 microversion: 2.1 time: 0.144419 Aug 26 06:22:49.697728 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 417/845] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:49 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1620 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:49.710816 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e6d5107d-2fd1-4afd-b388-c42029eca0e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Going to try to terminate instance {{(pid=121343) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:22:49.901180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-f0ec4634-cfc3-4768-aed3-0cb790452c2f req-de82abe8-d6e5-4564-87a2-181c2e931374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45330505-4b58-4762-bb9f-e704f9648e1e", "name": "network-vif-deleted", "tag": "2064b241-4b48-43a2-ba54-14c868b539b4"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:22:49.916346 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f0ec4634-cfc3-4768-aed3-0cb790452c2f req-de82abe8-d6e5-4564-87a2-181c2e931374 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:49.916934 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f0ec4634-cfc3-4768-aed3-0cb790452c2f req-de82abe8-d6e5-4564-87a2-181c2e931374 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:49.917369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f0ec4634-cfc3-4768-aed3-0cb790452c2f req-de82abe8-d6e5-4564-87a2-181c2e931374 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:49.930804 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-f0ec4634-cfc3-4768-aed3-0cb790452c2f req-de82abe8-d6e5-4564-87a2-181c2e931374 service nova] Creating event network-vif-deleted:2064b241-4b48-43a2-ba54-14c868b539b4 for instance 45330505-4b58-4762-bb9f-e704f9648e1e on hv-cinder-85391 Aug 26 06:22:49.938367 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-f0ec4634-cfc3-4768-aed3-0cb790452c2f req-de82abe8-d6e5-4564-87a2-181c2e931374 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041211 Aug 26 06:22:49.940821 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 418/846] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:22:50.196193 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e6d5107d-2fd1-4afd-b388-c42029eca0e3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 204 len: 0 microversion: 2.20 time: 0.533703 Aug 26 06:22:50.196786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 429/847] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 26 06:22:49 2022] DELETE /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 26 06:22:50.206339 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:50.207525 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:50.214178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:50.214994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:50.215931 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:50.217409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:50.218387 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:50.219303 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:50.370645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:50.383471 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:50.385035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:50.386339 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e33fb567-82f6-42ad-8038-a6ec469cc702 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.185020 Aug 26 06:22:50.387046 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 419/848] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:22:50 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:22:50.720739 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:50.721915 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:50.731764 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:50.732565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:50.733316 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:50.734527 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:50.735387 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:50.736921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:50.780839 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:50.781102 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:50.781570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:50.782040 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lazy-loading 'fault' on Instance uuid 45330505-4b58-4762-bb9f-e704f9648e1e {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:22:50.834321 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:50.850789 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5022176e-c5ec-4959-92b5-fe9a726accb7 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1334 microversion: 2.1 time: 0.135065 Aug 26 06:22:50.851384 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 430/849] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:50 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1334 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:22:51.420175 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:51.420772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:51.428235 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:51.428754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:51.429186 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:51.433462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:51.433462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:51.433462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:51.578867 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:51.592608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:51.594375 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:51.596262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9fc4b1e1-f868-404c-a9a6-71f170f6d05b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1723 microversion: 2.20 time: 0.179498 Aug 26 06:22:51.596796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 420/850] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:22:51 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:22:51.876007 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:51.877291 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:51.884498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:51.884994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:51.885432 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:51.886132 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:51.886585 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:51.887050 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:51.929311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:51.930006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:51.930605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:51.931216 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lazy-loading 'fault' on Instance uuid 45330505-4b58-4762-bb9f-e704f9648e1e {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:22:51.981596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:51.990919 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-892b03f3-1b64-4e48-95e9-7f43d031db93 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 200 len: 1334 microversion: 2.1 time: 0.118640 Aug 26 06:22:51.991678 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 431/851] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:51 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 1334 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:22:52.621816 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:52.623084 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:52.634910 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:52.635672 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:52.639811 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:52.639811 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:52.639811 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:52.639811 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:52.769363 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:52.779381 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:52.781190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:52.782390 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b39f0d84-d868-49e8-8bab-22c110528c19 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1655 microversion: 2.20 time: 0.165874 Aug 26 06:22:52.784151 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 421/852] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:22:52 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1655 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:22:53.012999 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:53.014440 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 45330505-4b58-4762-bb9f-e704f9648e1e] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:53.022395 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:53.022935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:53.023377 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:53.024074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:53.024529 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:53.024955 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:53.044861 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-493e00a8-4104-4708-a07d-571a88f255c4 req-221eb3e1-4d4a-44cc-a575-b331341c748c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c", "name": "network-vif-deleted", "tag": "3b7fc810-cb09-42a2-a246-9a1fd1d7d061"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:22:53.056358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-493e00a8-4104-4708-a07d-571a88f255c4 req-221eb3e1-4d4a-44cc-a575-b331341c748c service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:53.056860 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-493e00a8-4104-4708-a07d-571a88f255c4 req-221eb3e1-4d4a-44cc-a575-b331341c748c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:53.057282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-493e00a8-4104-4708-a07d-571a88f255c4 req-221eb3e1-4d4a-44cc-a575-b331341c748c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:53.070222 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-493e00a8-4104-4708-a07d-571a88f255c4 req-221eb3e1-4d4a-44cc-a575-b331341c748c service nova] Creating event network-vif-deleted:3b7fc810-cb09-42a2-a246-9a1fd1d7d061 for instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c on hv-cinder-85391 Aug 26 06:22:53.073544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] HTTP exception thrown: Instance 45330505-4b58-4762-bb9f-e704f9648e1e could not be found. Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Request method failure captured: Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e HTTP/1.1 Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGVFBJkPt1N_LAygoJk3npVpvTaiY6oESY7H7eIhb_pE7vIfLRLef0yZ0WO-eOYSAOu29g7tC4almRLKeCmwL68LeS-3Lt-Rocdb4_uhlsXGoOdyOmAFICyobY7aGtCo9lib4xItQIjA7QHpX69KFGmPiDgQ7mjKlhTYlPfqbJSO7CA Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: 84a2eee4447b4eadb79fbdbb874d4476 Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:22:53.075875 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: 84a2eee4447b4eadb79fbdbb874d4476 Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-ServerRescueNegativeTestJSON-952056989-project Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 8d154e96376a49918658b0c340c722e9 Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-ServerRescueNegativeTestJSON-952056989-project Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance 45330505-4b58-4762-bb9f-e704f9648e1e could not be found. Aug 26 06:22:53.077523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': '45330505-4b58-4762-bb9f-e704f9648e1e'} Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45330505-4b58-4762-bb9f-e704f9648e1e could not be found. Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:22:53.078296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45330505-4b58-4762-bb9f-e704f9648e1e could not be found. Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45330505-4b58-4762-bb9f-e704f9648e1e could not be found. Aug 26 06:22:53.080312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:22:53.081948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Returning 404 to user: Instance 45330505-4b58-4762-bb9f-e704f9648e1e could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:22:53.081948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-62db694d-3ad7-4eaf-9844-930a035cbe6e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e" status: 404 len: 111 microversion: 2.1 time: 0.068357 Aug 26 06:22:53.081948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 432/853] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:53 2022] GET /compute/v2.1/servers/45330505-4b58-4762-bb9f-e704f9648e1e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:22:53.083959 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-493e00a8-4104-4708-a07d-571a88f255c4 req-221eb3e1-4d4a-44cc-a575-b331341c748c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043774 Aug 26 06:22:53.084566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 422/854] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:22:53.087746 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d4c2db96-6a06-4aaf-947d-383cb0fe8214 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '.version_select at 0x7f2f08f98c10>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:53.250934 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d4c2db96-6a06-4aaf-947d-383cb0fe8214 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-896541118" status: 202 len: 0 microversion: 2.1 time: 0.167060 Aug 26 06:22:53.254175 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 433/855] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 26 06:22:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-896541118 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:22:53.810844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:53.811749 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:53.825659 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:53.831771 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:53.831771 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:53.831771 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:53.831771 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:53.832443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:53.899127 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:53.899623 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:53.900059 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:53.900511 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lazy-loading 'fault' on Instance uuid ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:22:53.970590 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:53.980945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:53.982486 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:53.983715 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3da1ce65-e59d-48b3-bd64-b872551de72d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1370 microversion: 2.20 time: 0.178490 Aug 26 06:22:53.984271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 423/856] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:22:53 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:22:55.008442 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:55.009288 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:55.016747 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:55.017430 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:55.017750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:55.018588 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:55.019119 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:55.019589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:55.040999 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:55.055695 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:55.056187 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:55.056634 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:55.057081 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lazy-loading 'fault' on Instance uuid ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:22:55.108107 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:55.117336 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:55.118857 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:55.120081 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-48b9c418-9d09-49f2-a714-765255fd7718 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 200 len: 1370 microversion: 2.20 time: 0.116363 Aug 26 06:22:55.120634 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 434/857] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:22:55 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 1370 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:22:56.144037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:56.144646 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:56.151020 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:56.151500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:56.151952 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:56.152630 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:56.153092 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:56.153516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:56.169331 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] HTTP exception thrown: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Request method failure captured: Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c HTTP/1.1 Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGWutM-sLT0NZtBZswCfyB5Brh2v35yolGm0RJm3JvSkiPzE5IpNeA4cCtaPPp0h3bow4W9mMFhie80VCAm2mwFxWvIPyK63YBAIl18RNDSFNAhwyq7QEvZBcnzv7M9Qcf53QnIfe0xfaZMMBjqYPGZOubwo-naAdzAfMeJKbO21jLY Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:22:56.171009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 660c6df77d0a4750aac30345d6768526 Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:22:56.172653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c'} Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:22:56.174338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:22:56.175721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:22:56.177110 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Returning 404 to user: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:22:56.177110 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1b8d68c4-4e1e-43d0-8cf1-b259cb2ebb2c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 404 len: 111 microversion: 2.20 time: 0.032382 Aug 26 06:22:56.177110 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 424/858] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:22:56 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 06:22:56.182249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a7c875bf-c7d6-4366-aa63-920044bf517a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '.version_select at 0x7f2f08f98e50>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:56.459787 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a7c875bf-c7d6-4366-aa63-920044bf517a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-890970038" status: 204 len: 0 microversion: 2.20 time: 0.281161 Aug 26 06:22:56.460380 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 435/859] 10.222.0.40 () {60 vars in 1259 bytes} [Fri Aug 26 06:22:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-890970038 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 06:22:57.457365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f288021e-ecfa-429a-adc3-833a8ba4fbca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Action: 'create', calling method: .version_select at 0x7f2f08da9e50>, body: {"keypair": {"name": "tempest-keypair-1447197145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt/jeindAMNU+uWZdUrIzQJTRrm4m+POAH/zjwUk98oIq51FX1GjsDcdlJJ3lY27nSGcg43idNmP9Cu4KCkLDaPasm9VlS2iNSFrDCG70d5V3qCkFFngZqwjOEgwgsGmw=="}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:22:57.475469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-f288021e-ecfa-429a-adc3-833a8ba4fbca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Getting quotas for project f7e0c375a58842e18a4306779fd6e167. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:22:57.479783 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-f288021e-ecfa-429a-adc3-833a8ba4fbca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Getting quotas for user 660c6df77d0a4750aac30345d6768526 and project f7e0c375a58842e18a4306779fd6e167. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:22:57.620678 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e2183391-6469-465f-a7b7-8c618fd42724 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:57.621249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e2183391-6469-465f-a7b7-8c618fd42724 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:57.629354 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e2183391-6469-465f-a7b7-8c618fd42724 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:57.629847 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e2183391-6469-465f-a7b7-8c618fd42724 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:57.630264 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e2183391-6469-465f-a7b7-8c618fd42724 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:57.631009 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e2183391-6469-465f-a7b7-8c618fd42724 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:57.631465 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e2183391-6469-465f-a7b7-8c618fd42724 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:57.631877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e2183391-6469-465f-a7b7-8c618fd42724 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:57.660291 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e2183391-6469-465f-a7b7-8c618fd42724 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Going to try to terminate instance {{(pid=121343) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:22:57.718841 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f288021e-ecfa-429a-adc3-833a8ba4fbca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.266084 Aug 26 06:22:57.719561 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 425/860] 10.222.0.40 () {62 vars in 1200 bytes} [Fri Aug 26 06:22:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 268 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 06:22:58.155737 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e2183391-6469-465f-a7b7-8c618fd42724 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 204 len: 0 microversion: 2.1 time: 0.538512 Aug 26 06:22:58.156648 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 436/861] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:22:57 2022] DELETE /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 06:22:58.165971 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8e6f8079-d149-4b83-b200-2a9fea9ce249 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:58.166660 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8e6f8079-d149-4b83-b200-2a9fea9ce249 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:58.177347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e6f8079-d149-4b83-b200-2a9fea9ce249 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:58.177826 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e6f8079-d149-4b83-b200-2a9fea9ce249 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:58.178262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e6f8079-d149-4b83-b200-2a9fea9ce249 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:58.181117 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e6f8079-d149-4b83-b200-2a9fea9ce249 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:58.189471 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e6f8079-d149-4b83-b200-2a9fea9ce249 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:58.190834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8e6f8079-d149-4b83-b200-2a9fea9ce249 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:58.401260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:22:58.526012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8e6f8079-d149-4b83-b200-2a9fea9ce249 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:58.544235 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8e6f8079-d149-4b83-b200-2a9fea9ce249 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1508 microversion: 2.1 time: 0.381953 Aug 26 06:22:58.546919 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 426/862] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:58 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1508 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:22:59.631908 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7b64c4a6-e32c-436a-bf3f-609dd64ab34e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:22:59.632605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7b64c4a6-e32c-436a-bf3f-609dd64ab34e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:22:59.640345 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b64c4a6-e32c-436a-bf3f-609dd64ab34e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:59.640864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b64c4a6-e32c-436a-bf3f-609dd64ab34e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:59.641516 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b64c4a6-e32c-436a-bf3f-609dd64ab34e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:59.642227 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b64c4a6-e32c-436a-bf3f-609dd64ab34e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:22:59.642885 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b64c4a6-e32c-436a-bf3f-609dd64ab34e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:22:59.643913 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b64c4a6-e32c-436a-bf3f-609dd64ab34e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:22:59.801044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7b64c4a6-e32c-436a-bf3f-609dd64ab34e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:22:59.820552 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7b64c4a6-e32c-436a-bf3f-609dd64ab34e tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1508 microversion: 2.1 time: 0.193644 Aug 26 06:22:59.821698 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 437/863] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:22:59 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:00.193596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-da9ab8bc-bb73-4bd1-b914-6559bb42a2a5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-948216797"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:00.194463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-da9ab8bc-bb73-4bd1-b914-6559bb42a2a5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:00.203620 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-da9ab8bc-bb73-4bd1-b914-6559bb42a2a5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:00.204013 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-da9ab8bc-bb73-4bd1-b914-6559bb42a2a5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:00.204682 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-da9ab8bc-bb73-4bd1-b914-6559bb42a2a5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:00.206326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-da9ab8bc-bb73-4bd1-b914-6559bb42a2a5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:00.206822 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-da9ab8bc-bb73-4bd1-b914-6559bb42a2a5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:00.207250 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-da9ab8bc-bb73-4bd1-b914-6559bb42a2a5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:00.535759 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.network.security_group_api [None req-da9ab8bc-bb73-4bd1-b914-6559bb42a2a5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Removing security group 7875ffc9-e6f0-4862-8815-e1c917165a02 from port f4d37966-d902-4c07-9ee5-4be2e42d1714 Aug 26 06:23:00.843289 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-218db52a-b5a4-42ed-a780-afc66f2f6369 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:00.844531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-218db52a-b5a4-42ed-a780-afc66f2f6369 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:00.870591 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-218db52a-b5a4-42ed-a780-afc66f2f6369 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:00.870591 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-218db52a-b5a4-42ed-a780-afc66f2f6369 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:00.870591 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-218db52a-b5a4-42ed-a780-afc66f2f6369 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:00.870591 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-218db52a-b5a4-42ed-a780-afc66f2f6369 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:00.872478 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-218db52a-b5a4-42ed-a780-afc66f2f6369 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:00.873127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-218db52a-b5a4-42ed-a780-afc66f2f6369 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:01.090817 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-218db52a-b5a4-42ed-a780-afc66f2f6369 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:01.101925 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-218db52a-b5a4-42ed-a780-afc66f2f6369 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1466 microversion: 2.1 time: 0.262093 Aug 26 06:23:01.103011 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 438/864] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:00 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1466 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:23:01.109867 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-39ab536a-554f-49ed-bac4-0bfa2b30deb0 req-f1f0612e-530f-4f0e-8c65-e7f7879878bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea7e392a-1a02-4faa-a63e-5ac717bd2537", "name": "network-vif-deleted", "tag": "40c6359b-4d02-4846-9ca2-697e2425c559"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:01.125365 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-39ab536a-554f-49ed-bac4-0bfa2b30deb0 req-f1f0612e-530f-4f0e-8c65-e7f7879878bd service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:01.127030 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-39ab536a-554f-49ed-bac4-0bfa2b30deb0 req-f1f0612e-530f-4f0e-8c65-e7f7879878bd service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:01.127700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-39ab536a-554f-49ed-bac4-0bfa2b30deb0 req-f1f0612e-530f-4f0e-8c65-e7f7879878bd service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:01.147417 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-39ab536a-554f-49ed-bac4-0bfa2b30deb0 req-f1f0612e-530f-4f0e-8c65-e7f7879878bd service nova] Creating event network-vif-deleted:40c6359b-4d02-4846-9ca2-697e2425c559 for instance ea7e392a-1a02-4faa-a63e-5ac717bd2537 on hv-cinder-85391 Aug 26 06:23:01.151376 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-da9ab8bc-bb73-4bd1-b914-6559bb42a2a5 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "POST /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/action" status: 202 len: 0 microversion: 2.1 time: 0.964434 Aug 26 06:23:01.152297 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 427/865] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:23:00 2022] POST /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/action => generated 0 bytes in 966 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:23:01.157606 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-39ab536a-554f-49ed-bac4-0bfa2b30deb0 req-f1f0612e-530f-4f0e-8c65-e7f7879878bd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052266 Aug 26 06:23:01.158563 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 439/866] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:02.131413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:02.136566 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:02.140711 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:02.141490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:02.142480 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:02.143515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:02.144229 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:02.145012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:02.198499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:02.199372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:02.199932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:02.200601 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lazy-loading 'fault' on Instance uuid ea7e392a-1a02-4faa-a63e-5ac717bd2537 {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:23:02.254726 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:02.263144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d027c6b9-21d5-4ad0-873c-86a45f648327 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 200 len: 1312 microversion: 2.1 time: 0.139833 Aug 26 06:23:02.263703 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 428/867] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:02 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 1312 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:02.857517 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-332725757", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0329fd48-f6a9-4c16-8004-ab5a1f76eb8f"}], "security_groups": [{"name": "tempest-securitygroup--613636229"}], "key_name": "tempest-keypair-1447197145", "user_data": "}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:03.085907 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.network.neutron [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] validate_networks() for [('0329fd48-f6a9-4c16-8004-ab5a1f76eb8f', None, None, None, None, None)] {{(pid=121343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:23:03.233516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-01c67bcf-dc82-47e6-9f18-e76808b2e95c req-555d3f8d-ddaa-4908-905c-5d4ab07537f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff368667-d93b-4b10-9606-09331ebb857c", "tag": "f4d37966-d902-4c07-9ee5-4be2e42d1714"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:03.256017 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-01c67bcf-dc82-47e6-9f18-e76808b2e95c req-555d3f8d-ddaa-4908-905c-5d4ab07537f3 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:03.256850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-01c67bcf-dc82-47e6-9f18-e76808b2e95c req-555d3f8d-ddaa-4908-905c-5d4ab07537f3 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:03.257455 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-01c67bcf-dc82-47e6-9f18-e76808b2e95c req-555d3f8d-ddaa-4908-905c-5d4ab07537f3 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:03.281166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-01c67bcf-dc82-47e6-9f18-e76808b2e95c req-555d3f8d-ddaa-4908-905c-5d4ab07537f3 service nova] Creating event network-changed:f4d37966-d902-4c07-9ee5-4be2e42d1714 for instance ff368667-d93b-4b10-9606-09331ebb857c on hv-cinder-85391 Aug 26 06:23:03.288848 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-01c67bcf-dc82-47e6-9f18-e76808b2e95c req-555d3f8d-ddaa-4908-905c-5d4ab07537f3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059234 Aug 26 06:23:03.289700 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 429/868] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:23:03.311474 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:03.315751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: ea7e392a-1a02-4faa-a63e-5ac717bd2537] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:03.324953 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:03.325545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:03.325932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:03.326673 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:03.327145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:03.327562 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:03.369183 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] HTTP exception thrown: Instance ea7e392a-1a02-4faa-a63e-5ac717bd2537 could not be found. Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Request method failure captured: Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 HTTP/1.1 Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGVFBJkPt1N_LAygoJk3npVpvTaiY6oESY7H7eIhb_pE7vIfLRLef0yZ0WO-eOYSAOu29g7tC4almRLKeCmwL68LeS-3Lt-Rocdb4_uhlsXGoOdyOmAFICyobY7aGtCo9lib4xItQIjA7QHpX69KFGmPiDgQ7mjKlhTYlPfqbJSO7CA Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: 84a2eee4447b4eadb79fbdbb874d4476 Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:23:03.372958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: 84a2eee4447b4eadb79fbdbb874d4476 Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-ServerRescueNegativeTestJSON-952056989-project Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 8d154e96376a49918658b0c340c722e9 Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-ServerRescueNegativeTestJSON-952056989-project Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance ea7e392a-1a02-4faa-a63e-5ac717bd2537 could not be found. Aug 26 06:23:03.374807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'ea7e392a-1a02-4faa-a63e-5ac717bd2537'} Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea7e392a-1a02-4faa-a63e-5ac717bd2537 could not be found. Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:23:03.375757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea7e392a-1a02-4faa-a63e-5ac717bd2537 could not be found. Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea7e392a-1a02-4faa-a63e-5ac717bd2537 could not be found. Aug 26 06:23:03.377842 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:23:03.381177 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Returning 404 to user: Instance ea7e392a-1a02-4faa-a63e-5ac717bd2537 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:23:03.382495 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-056769b0-4d67-49cb-832b-165dbba5334c tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537" status: 404 len: 111 microversion: 2.1 time: 0.090894 Aug 26 06:23:03.383579 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 430/869] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:03 2022] GET /compute/v2.1/servers/ea7e392a-1a02-4faa-a63e-5ac717bd2537 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:23:03.412458 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b6d9f806-56ee-4067-b6fe-cfdd8983738b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:03.413276 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b6d9f806-56ee-4067-b6fe-cfdd8983738b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:03.448031 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6d9f806-56ee-4067-b6fe-cfdd8983738b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:03.448570 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6d9f806-56ee-4067-b6fe-cfdd8983738b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:03.455281 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6d9f806-56ee-4067-b6fe-cfdd8983738b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:03.456721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6d9f806-56ee-4067-b6fe-cfdd8983738b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:03.457075 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6d9f806-56ee-4067-b6fe-cfdd8983738b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:03.457803 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b6d9f806-56ee-4067-b6fe-cfdd8983738b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:03.520463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b6d9f806-56ee-4067-b6fe-cfdd8983738b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:23:04.218145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b6d9f806-56ee-4067-b6fe-cfdd8983738b tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 204 len: 0 microversion: 2.1 time: 0.806737 Aug 26 06:23:04.218839 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 431/870] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:23:03 2022] DELETE /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:23:04.229863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d9eee89d-f24b-47a7-a445-42036285ad84 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:04.233964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d9eee89d-f24b-47a7-a445-42036285ad84 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:04.246501 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d9eee89d-f24b-47a7-a445-42036285ad84 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:04.247019 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d9eee89d-f24b-47a7-a445-42036285ad84 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:04.247464 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d9eee89d-f24b-47a7-a445-42036285ad84 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:04.248199 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d9eee89d-f24b-47a7-a445-42036285ad84 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:04.251966 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d9eee89d-f24b-47a7-a445-42036285ad84 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:04.252431 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d9eee89d-f24b-47a7-a445-42036285ad84 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:04.361498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Flavor limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:23:04.361988 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Image limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:23:04.362385 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Flavor pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:23:04.362860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Image pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:23:04.363269 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:23:04.371516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-d9eee89d-f24b-47a7-a445-42036285ad84 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lazy-loading 'services' on Instance uuid ff368667-d93b-4b10-9606-09331ebb857c {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:23:04.383337 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:04.384160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:04.384801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:04.385623 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:04.386795 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:04.387468 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:04.422817 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Getting quotas for project f7e0c375a58842e18a4306779fd6e167. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:23:04.437601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Getting quotas for user 660c6df77d0a4750aac30345d6768526 and project f7e0c375a58842e18a4306779fd6e167. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:23:04.454470 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Going to run 1 instances... {{(pid=121343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:23:04.460268 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:23:04.991382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [54acfe83-7b3b-468c-bd6f-1e1174ac946b] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 26 06:23:05.121245 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d9eee89d-f24b-47a7-a445-42036285ad84 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments/baf57c4b-81d0-478a-bccd-140904f07eda" status: 202 len: 0 microversion: 2.1 time: 0.895823 Aug 26 06:23:05.122007 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 432/871] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:23:04 2022] DELETE /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments/baf57c4b-81d0-478a-bccd-140904f07eda => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:23:05.130812 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-72c67d72-f72a-4bdd-b169-6d053cd0d7ed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:05.131526 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-72c67d72-f72a-4bdd-b169-6d053cd0d7ed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:05.138781 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72c67d72-f72a-4bdd-b169-6d053cd0d7ed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:05.139426 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72c67d72-f72a-4bdd-b169-6d053cd0d7ed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:05.139874 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72c67d72-f72a-4bdd-b169-6d053cd0d7ed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:05.140740 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72c67d72-f72a-4bdd-b169-6d053cd0d7ed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:05.141440 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72c67d72-f72a-4bdd-b169-6d053cd0d7ed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:05.142318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72c67d72-f72a-4bdd-b169-6d053cd0d7ed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:05.312443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-72c67d72-f72a-4bdd-b169-6d053cd0d7ed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:05.322161 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-72c67d72-f72a-4bdd-b169-6d053cd0d7ed tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.198651 Aug 26 06:23:05.322757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 433/872] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:05 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:05.328128 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a387ced2-2f5b-4899-9d4f-e9069bb06383 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:05.330582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a387ced2-2f5b-4899-9d4f-e9069bb06383 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:05.342927 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a387ced2-2f5b-4899-9d4f-e9069bb06383 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:05.342927 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a387ced2-2f5b-4899-9d4f-e9069bb06383 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:05.342927 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a387ced2-2f5b-4899-9d4f-e9069bb06383 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:05.342927 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a387ced2-2f5b-4899-9d4f-e9069bb06383 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:05.343538 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a387ced2-2f5b-4899-9d4f-e9069bb06383 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:05.343538 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a387ced2-2f5b-4899-9d4f-e9069bb06383 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:05.373272 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a387ced2-2f5b-4899-9d4f-e9069bb06383 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049446 Aug 26 06:23:05.373904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 434/873] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:23:05 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:05.379376 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-f7b729a8-54a9-4361-97e6-b1e943a0c4db req-5701d132-01d4-476d-989d-53a744fc028b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff368667-d93b-4b10-9606-09331ebb857c", "tag": "f4d37966-d902-4c07-9ee5-4be2e42d1714"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:05.389898 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f7b729a8-54a9-4361-97e6-b1e943a0c4db req-5701d132-01d4-476d-989d-53a744fc028b service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:05.390231 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f7b729a8-54a9-4361-97e6-b1e943a0c4db req-5701d132-01d4-476d-989d-53a744fc028b service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:05.390688 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f7b729a8-54a9-4361-97e6-b1e943a0c4db req-5701d132-01d4-476d-989d-53a744fc028b service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:05.403035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-f7b729a8-54a9-4361-97e6-b1e943a0c4db req-5701d132-01d4-476d-989d-53a744fc028b service nova] Creating event network-changed:f4d37966-d902-4c07-9ee5-4be2e42d1714 for instance ff368667-d93b-4b10-9606-09331ebb857c on hv-cinder-85391 Aug 26 06:23:05.408714 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-f7b729a8-54a9-4361-97e6-b1e943a0c4db req-5701d132-01d4-476d-989d-53a744fc028b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033596 Aug 26 06:23:05.409435 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 435/874] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:05.998372 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO oslo.messaging._drivers.impl_rabbit [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [54acfe83-7b3b-468c-bd6f-1e1174ac946b] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 34412. Aug 26 06:23:06.011937 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a14e6017-1b34-4661-975e-a6e8f2257abc tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.164348 Aug 26 06:23:06.019196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 440/875] 10.222.0.40 () {62 vars in 1188 bytes} [Fri Aug 26 06:23:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 3173 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 06:23:06.025115 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a9c25c5d-714e-434b-9cda-d504af3af272 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:06.025584 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a9c25c5d-714e-434b-9cda-d504af3af272 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:06.176069 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a9c25c5d-714e-434b-9cda-d504af3af272 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:06.186795 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a9c25c5d-714e-434b-9cda-d504af3af272 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:06.192364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a9c25c5d-714e-434b-9cda-d504af3af272 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:06.194212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a9c25c5d-714e-434b-9cda-d504af3af272 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1281 microversion: 2.20 time: 0.173761 Aug 26 06:23:06.194800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 436/876] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:06 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1281 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:06.346124 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ad68bccd-4b89-43b8-b92a-a52b8c3a800f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:06.347501 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ad68bccd-4b89-43b8-b92a-a52b8c3a800f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:06.354633 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad68bccd-4b89-43b8-b92a-a52b8c3a800f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:06.359129 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad68bccd-4b89-43b8-b92a-a52b8c3a800f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:06.359129 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad68bccd-4b89-43b8-b92a-a52b8c3a800f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:06.359129 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad68bccd-4b89-43b8-b92a-a52b8c3a800f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:06.359129 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad68bccd-4b89-43b8-b92a-a52b8c3a800f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:06.359732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad68bccd-4b89-43b8-b92a-a52b8c3a800f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:06.389690 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-27d4e709-9779-4f97-af7c-c8f7038e1839 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:06.396141 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-27d4e709-9779-4f97-af7c-c8f7038e1839 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:06.416978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27d4e709-9779-4f97-af7c-c8f7038e1839 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:06.419421 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27d4e709-9779-4f97-af7c-c8f7038e1839 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:06.420047 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27d4e709-9779-4f97-af7c-c8f7038e1839 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:06.420944 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27d4e709-9779-4f97-af7c-c8f7038e1839 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:06.421568 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27d4e709-9779-4f97-af7c-c8f7038e1839 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:06.422326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-27d4e709-9779-4f97-af7c-c8f7038e1839 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:06.459034 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-27d4e709-9779-4f97-af7c-c8f7038e1839 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075155 Aug 26 06:23:06.464722 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 437/877] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:23:06 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:06.563892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ad68bccd-4b89-43b8-b92a-a52b8c3a800f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:06.573532 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ad68bccd-4b89-43b8-b92a-a52b8c3a800f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1521 microversion: 2.1 time: 0.232587 Aug 26 06:23:06.589055 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 441/878] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:06 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:07.220620 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e399cc2b-e8eb-421c-926a-02723a164cb5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:07.221440 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e399cc2b-e8eb-421c-926a-02723a164cb5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:07.288232 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e399cc2b-e8eb-421c-926a-02723a164cb5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:07.296558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e399cc2b-e8eb-421c-926a-02723a164cb5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:07.306796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e399cc2b-e8eb-421c-926a-02723a164cb5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:07.313909 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e399cc2b-e8eb-421c-926a-02723a164cb5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1281 microversion: 2.20 time: 0.099311 Aug 26 06:23:07.327805 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 438/879] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:07 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:07.449046 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-73088db8-289d-4a39-8d08-7dc36ff6d12b req-675341cc-22ea-4db2-b86e-56a4d0c5cdd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3647fa12-4de4-4b81-aca1-4687ec0af8f9", "name": "network-vif-deleted", "tag": "25e49a9c-7d0c-440b-b98b-c8b9503ba03f"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:07.466724 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-73088db8-289d-4a39-8d08-7dc36ff6d12b req-675341cc-22ea-4db2-b86e-56a4d0c5cdd3 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:07.467951 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-73088db8-289d-4a39-8d08-7dc36ff6d12b req-675341cc-22ea-4db2-b86e-56a4d0c5cdd3 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:07.468880 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-73088db8-289d-4a39-8d08-7dc36ff6d12b req-675341cc-22ea-4db2-b86e-56a4d0c5cdd3 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:07.471924 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-67682085-efc7-4639-ba69-156b11529cd2 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:07.474167 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-67682085-efc7-4639-ba69-156b11529cd2 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:07.481980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67682085-efc7-4639-ba69-156b11529cd2 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:07.482480 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67682085-efc7-4639-ba69-156b11529cd2 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:07.482962 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67682085-efc7-4639-ba69-156b11529cd2 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:07.483676 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67682085-efc7-4639-ba69-156b11529cd2 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:07.484316 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67682085-efc7-4639-ba69-156b11529cd2 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:07.484755 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-67682085-efc7-4639-ba69-156b11529cd2 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:07.495938 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-73088db8-289d-4a39-8d08-7dc36ff6d12b req-675341cc-22ea-4db2-b86e-56a4d0c5cdd3 service nova] Creating event network-vif-deleted:25e49a9c-7d0c-440b-b98b-c8b9503ba03f for instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 on hv-cinder-85391 Aug 26 06:23:07.502034 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-73088db8-289d-4a39-8d08-7dc36ff6d12b req-675341cc-22ea-4db2-b86e-56a4d0c5cdd3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058449 Aug 26 06:23:07.503216 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 442/880] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:07.545755 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-67682085-efc7-4639-ba69-156b11529cd2 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077667 Aug 26 06:23:07.551368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 439/881] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:23:07 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 06:23:07.560404 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:07.560975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:07.569246 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:07.569725 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:07.570690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:07.571663 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:07.572333 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:07.572910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:07.599214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-89344695-09d9-4c63-adb2-f907a2d6951d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:07.600389 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-89344695-09d9-4c63-adb2-f907a2d6951d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:07.609637 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89344695-09d9-4c63-adb2-f907a2d6951d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:07.611724 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89344695-09d9-4c63-adb2-f907a2d6951d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:07.612391 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89344695-09d9-4c63-adb2-f907a2d6951d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:07.614448 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89344695-09d9-4c63-adb2-f907a2d6951d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:07.615479 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89344695-09d9-4c63-adb2-f907a2d6951d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:07.616115 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89344695-09d9-4c63-adb2-f907a2d6951d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:07.710739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-89344695-09d9-4c63-adb2-f907a2d6951d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:07.721345 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] HTTP exception thrown: Instance ff368667-d93b-4b10-9606-09331ebb857c is not attached to volume baf57c4b-81d0-478a-bccd-140904f07eda Aug 26 06:23:07.722744 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-89344695-09d9-4c63-adb2-f907a2d6951d tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1479 microversion: 2.1 time: 0.129432 Aug 26 06:23:07.723581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 440/882] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:07 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1479 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Request method failure captured: Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: DELETE /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments/baf57c4b-81d0-478a-bccd-140904f07eda HTTP/1.1 Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGXlK_tt1FsLE6FdDXih5anIG381k3ER1le-G8dcETyP60GGRbuNSu-zw9tTFeIN7ieaZkFj4yyrc9m9Ee-vs8AlNfC4jAqPeKyqgVHVPXscRQGu5aIUvg3rfq4NCzgmV0z5butP6Hrm9_p8X8__uUhksb_BErWLFfCVMh0fTg08e8Y Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: 01817da1260c41b4abe6f02b11c66232 Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-TestMinimumBasicScenario-1379140524 Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:23:07.744629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:23:07.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/01817da1260c41b4abe6f02b11c66232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/01817da1260c41b4abe6f02b11c66232"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/01817da1260c41b4abe6f02b11c66232"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_01817da1260c41b4abe6f02b11c66232"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:23:07.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-TestMinimumBasicScenario-1379140524 Aug 26 06:23:07.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: 01817da1260c41b4abe6f02b11c66232 Aug 26 06:23:07.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1379140524 Aug 26 06:23:07.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-TestMinimumBasicScenario-1379140524-project Aug 26 06:23:07.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:23:07.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:23:07.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 61318fafe2a1469c884b5290fe4ba366 Aug 26 06:23:07.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-TestMinimumBasicScenario-1379140524-project Aug 26 06:23:07.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:23:07.746042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance ff368667-d93b-4b10-9606-09331ebb857c is not attached to volume baf57c4b-81d0-478a-bccd-140904f07eda Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'server_id': 'ff368667-d93b-4b10-9606-09331ebb857c', 'id': 'baf57c4b-81d0-478a-bccd-140904f07eda'} Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id baf57c4b-81d0-478a-bccd-140904f07eda. Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:23:07.746819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff368667-d93b-4b10-9606-09331ebb857c is not attached to volume baf57c4b-81d0-478a-bccd-140904f07eda Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff368667-d93b-4b10-9606-09331ebb857c is not attached to volume baf57c4b-81d0-478a-bccd-140904f07eda Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:07.748511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Returning 404 to user: Instance ff368667-d93b-4b10-9606-09331ebb857c is not attached to volume baf57c4b-81d0-478a-bccd-140904f07eda {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:23:07.749429 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-49327dae-a481-44e6-8a62-3d16c7da3261 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments/baf57c4b-81d0-478a-bccd-140904f07eda" status: 404 len: 154 microversion: 2.1 time: 0.192194 Aug 26 06:23:07.751879 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 443/883] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:23:07 2022] DELETE /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c/os-volume_attachments/baf57c4b-81d0-478a-bccd-140904f07eda => generated 154 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:23:08.339162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:08.340202 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:08.346507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:08.347143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:08.348091 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:08.348999 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:08.350434 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:08.350973 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:08.428181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:08.437207 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:08.439708 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:08.441366 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fad2321d-f4d4-45fb-b1fa-d51cdaad317a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1277 microversion: 2.20 time: 0.106910 Aug 26 06:23:08.442709 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 441/884] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:08 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:23:08.747653 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:08.748262 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:08.756005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:08.756498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:08.756938 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:08.757843 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:08.758450 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:08.759103 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:08.793605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:08.800611 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:08.800611 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:08.800611 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lazy-loading 'fault' on Instance uuid 3647fa12-4de4-4b81-aca1-4687ec0af8f9 {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:23:08.846814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d154e96376a49918658b0c340c722e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a2eee4447b4eadb79fbdbb874d4476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:08.851274 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0434b351-be4f-460e-8004-88b8004d0f5f tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 200 len: 1312 microversion: 2.1 time: 0.107760 Aug 26 06:23:08.852084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 444/885] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:08 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:09.361681 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1e9d1fe2-2d68-4705-b3ea-1976fcfcf313 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:09.364064 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1e9d1fe2-2d68-4705-b3ea-1976fcfcf313 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:09.383321 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e9d1fe2-2d68-4705-b3ea-1976fcfcf313 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:09.388839 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e9d1fe2-2d68-4705-b3ea-1976fcfcf313 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:09.389351 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e9d1fe2-2d68-4705-b3ea-1976fcfcf313 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:09.390113 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e9d1fe2-2d68-4705-b3ea-1976fcfcf313 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:09.390589 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e9d1fe2-2d68-4705-b3ea-1976fcfcf313 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:09.391043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1e9d1fe2-2d68-4705-b3ea-1976fcfcf313 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:09.425248 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1e9d1fe2-2d68-4705-b3ea-1976fcfcf313 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:23:09.467429 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:09.468641 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:09.484013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:09.484512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:09.485134 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:09.486412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:09.486908 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:09.487345 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:09.571312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:09.580807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:09.582431 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:09.583622 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-29c6419b-48c5-4b4f-80f0-fdd5c25335b6 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1333 microversion: 2.20 time: 0.120506 Aug 26 06:23:09.584194 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 445/886] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:09 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1333 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:09.874681 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:09.875360 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] [instance: 3647fa12-4de4-4b81-aca1-4687ec0af8f9] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:09.883094 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:09.883595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:09.884031 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:09.884748 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:09.885202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:09.885625 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:09.902054 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] HTTP exception thrown: Instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 could not be found. Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Request method failure captured: Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 HTTP/1.1 Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGVFBJkPt1N_LAygoJk3npVpvTaiY6oESY7H7eIhb_pE7vIfLRLef0yZ0WO-eOYSAOu29g7tC4almRLKeCmwL68LeS-3Lt-Rocdb4_uhlsXGoOdyOmAFICyobY7aGtCo9lib4xItQIjA7QHpX69KFGmPiDgQ7mjKlhTYlPfqbJSO7CA Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: 84a2eee4447b4eadb79fbdbb874d4476 Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:23:09.903702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84a2eee4447b4eadb79fbdbb874d4476"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: 84a2eee4447b4eadb79fbdbb874d4476 Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-952056989 Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-ServerRescueNegativeTestJSON-952056989-project Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 8d154e96376a49918658b0c340c722e9 Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-ServerRescueNegativeTestJSON-952056989-project Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 could not be found. Aug 26 06:23:09.908728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': '3647fa12-4de4-4b81-aca1-4687ec0af8f9'} Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 could not be found. Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:23:09.909629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 could not be found. Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 could not be found. Aug 26 06:23:09.911201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:09.912512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] Returning 404 to user: Instance 3647fa12-4de4-4b81-aca1-4687ec0af8f9 could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:23:09.912512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-504aff1f-bd14-447b-9be4-2a1229f5a464 tempest-ServerRescueNegativeTestJSON-952056989 tempest-ServerRescueNegativeTestJSON-952056989-project] 10.222.0.40 "GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9" status: 404 len: 111 microversion: 2.1 time: 0.034837 Aug 26 06:23:09.912512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 446/887] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:09 2022] GET /compute/v2.1/servers/3647fa12-4de4-4b81-aca1-4687ec0af8f9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:23:09.986078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:10.103879 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1e9d1fe2-2d68-4705-b3ea-1976fcfcf313 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 204 len: 0 microversion: 2.1 time: 0.765718 Aug 26 06:23:10.104998 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 442/888] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:23:09 2022] DELETE /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 0 bytes in 769 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:23:10.115390 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-aad30508-81d7-43e1-ab76-97214c1ef422 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:10.116227 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-aad30508-81d7-43e1-ab76-97214c1ef422 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:10.124049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aad30508-81d7-43e1-ab76-97214c1ef422 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:10.124801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aad30508-81d7-43e1-ab76-97214c1ef422 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:10.125409 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aad30508-81d7-43e1-ab76-97214c1ef422 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:10.126963 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aad30508-81d7-43e1-ab76-97214c1ef422 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:10.127647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aad30508-81d7-43e1-ab76-97214c1ef422 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:10.128238 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aad30508-81d7-43e1-ab76-97214c1ef422 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:10.422979 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-aad30508-81d7-43e1-ab76-97214c1ef422 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:10.439712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-aad30508-81d7-43e1-ab76-97214c1ef422 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1556 microversion: 2.1 time: 0.329136 Aug 26 06:23:10.440909 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 447/889] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:10 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1556 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:10.608282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:10.609976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:10.616750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:10.617255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:10.617703 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:10.618489 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:10.618990 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:10.619424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:10.648569 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:10.731397 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:10.746269 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:10.748555 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:10.750475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4fe69fd2-7c1b-4c1f-8122-807b352392fa tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1351 microversion: 2.20 time: 0.146944 Aug 26 06:23:10.751751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 443/890] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:10 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:11.467387 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a92f94e7-254e-4ff4-88e9-a6bc4506dbfd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:11.468716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a92f94e7-254e-4ff4-88e9-a6bc4506dbfd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:11.480299 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a92f94e7-254e-4ff4-88e9-a6bc4506dbfd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:11.482509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a92f94e7-254e-4ff4-88e9-a6bc4506dbfd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:11.484420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a92f94e7-254e-4ff4-88e9-a6bc4506dbfd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:11.486575 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a92f94e7-254e-4ff4-88e9-a6bc4506dbfd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:11.488056 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a92f94e7-254e-4ff4-88e9-a6bc4506dbfd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:11.488677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a92f94e7-254e-4ff4-88e9-a6bc4506dbfd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:11.765076 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a92f94e7-254e-4ff4-88e9-a6bc4506dbfd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:11.777484 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:11.778097 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:11.786036 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:11.786533 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:11.787849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:11.787849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:11.788212 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:11.789067 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:11.791964 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a92f94e7-254e-4ff4-88e9-a6bc4506dbfd tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1556 microversion: 2.1 time: 0.330170 Aug 26 06:23:11.792548 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 448/891] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:11 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1556 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:11.934802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:11.946423 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:11.947993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:11.949114 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d3abc03e-4c1a-4b62-a8ee-f85b6f14e096 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1351 microversion: 2.20 time: 0.175660 Aug 26 06:23:11.950337 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 444/892] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:11 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1351 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:12.420547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-dbad8305-2571-4355-9502-0bbb356b6035 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:12.421481 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-dbad8305-2571-4355-9502-0bbb356b6035 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:12.427441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:12.435313 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbad8305-2571-4355-9502-0bbb356b6035 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:12.436075 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbad8305-2571-4355-9502-0bbb356b6035 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:12.436930 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbad8305-2571-4355-9502-0bbb356b6035 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:12.438254 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbad8305-2571-4355-9502-0bbb356b6035 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:12.439390 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbad8305-2571-4355-9502-0bbb356b6035 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:12.440583 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbad8305-2571-4355-9502-0bbb356b6035 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:12.481416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-dbad8305-2571-4355-9502-0bbb356b6035 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/ips" status: 200 len: 145 microversion: 2.1 time: 0.067757 Aug 26 06:23:12.483131 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 449/893] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 06:23:12 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/ips => generated 145 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:12.818081 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8074613c-35af-4e09-b9d4-9fe5e45476bf tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:12.818081 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8074613c-35af-4e09-b9d4-9fe5e45476bf tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:12.829282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8074613c-35af-4e09-b9d4-9fe5e45476bf tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:12.833904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8074613c-35af-4e09-b9d4-9fe5e45476bf tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:12.836822 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8074613c-35af-4e09-b9d4-9fe5e45476bf tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:12.837995 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8074613c-35af-4e09-b9d4-9fe5e45476bf tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:12.843814 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8074613c-35af-4e09-b9d4-9fe5e45476bf tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:12.844858 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8074613c-35af-4e09-b9d4-9fe5e45476bf tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:12.974375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:12.978535 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:12.989252 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:12.992697 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:12.993536 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:12.994662 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:12.996962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:12.997729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:13.179143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8074613c-35af-4e09-b9d4-9fe5e45476bf tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:13.229581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8074613c-35af-4e09-b9d4-9fe5e45476bf tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1514 microversion: 2.1 time: 0.418079 Aug 26 06:23:13.230199 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 445/894] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:12 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1514 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:13.263282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-5e54fbe5-9477-4a03-a25c-7ed92f80a425 req-8f220849-3c61-46a3-b185-11c32d34629d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff368667-d93b-4b10-9606-09331ebb857c", "name": "network-vif-deleted", "tag": "f4d37966-d902-4c07-9ee5-4be2e42d1714"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:13.280342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-5e54fbe5-9477-4a03-a25c-7ed92f80a425 req-8f220849-3c61-46a3-b185-11c32d34629d service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:13.284791 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-5e54fbe5-9477-4a03-a25c-7ed92f80a425 req-8f220849-3c61-46a3-b185-11c32d34629d service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:13.285477 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-5e54fbe5-9477-4a03-a25c-7ed92f80a425 req-8f220849-3c61-46a3-b185-11c32d34629d service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:13.310763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-5e54fbe5-9477-4a03-a25c-7ed92f80a425 req-8f220849-3c61-46a3-b185-11c32d34629d service nova] Creating event network-vif-deleted:f4d37966-d902-4c07-9ee5-4be2e42d1714 for instance ff368667-d93b-4b10-9606-09331ebb857c on hv-cinder-85391 Aug 26 06:23:13.321680 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-5e54fbe5-9477-4a03-a25c-7ed92f80a425 req-8f220849-3c61-46a3-b185-11c32d34629d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061920 Aug 26 06:23:13.323252 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 446/895] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:23:13.383566 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:13.394382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:13.395941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:13.397337 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-be79f02b-25fc-47fd-afdf-648bea1ab17e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1339 microversion: 2.20 time: 0.427442 Aug 26 06:23:13.398074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 450/896] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:12 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1339 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:23:14.254840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:14.255748 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:14.264021 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:14.265078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:14.265754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:14.266994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:14.267917 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:14.271221 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:14.332807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:14.333463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:14.333994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:14.335058 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lazy-loading 'fault' on Instance uuid ff368667-d93b-4b10-9606-09331ebb857c {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:23:14.431870 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:14.433400 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:14.452822 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:14.453756 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=6 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:14.465090 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:14.469258 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:14.473491 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:14.475112 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:14.481847 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:14.482977 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:14.483407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61318fafe2a1469c884b5290fe4ba366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01817da1260c41b4abe6f02b11c66232', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:14.514279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e48a53d3-c243-46ba-9505-ee886589edd6 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 200 len: 1349 microversion: 2.1 time: 0.256257 Aug 26 06:23:14.517471 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 447/897] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:14 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 1349 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:14.775746 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-cf33e676-6a11-4abc-8fd1-ab28fa7a848e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95241ed8-4d47-4d93-9351-b1ecca1f3567"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:14.780362 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-cf33e676-6a11-4abc-8fd1-ab28fa7a848e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:14.789215 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cf33e676-6a11-4abc-8fd1-ab28fa7a848e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:14.790094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cf33e676-6a11-4abc-8fd1-ab28fa7a848e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:14.790773 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cf33e676-6a11-4abc-8fd1-ab28fa7a848e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:14.791747 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cf33e676-6a11-4abc-8fd1-ab28fa7a848e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:14.792486 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cf33e676-6a11-4abc-8fd1-ab28fa7a848e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:14.793041 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-cf33e676-6a11-4abc-8fd1-ab28fa7a848e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:14.879887 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:14.907202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:14.916547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:14.921864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-07b7a4c9-9117-447a-b26d-0d19d7b96494 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1406 microversion: 2.20 time: 0.497207 Aug 26 06:23:14.945564 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 451/898] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:14 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:23:15.537870 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:15.538927 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] [instance: ff368667-d93b-4b10-9606-09331ebb857c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:15.554376 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:15.554935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:15.555399 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:15.556418 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:15.557047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:15.557668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:15.584313 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] HTTP exception thrown: Instance ff368667-d93b-4b10-9606-09331ebb857c could not be found. Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Request method failure captured: Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c HTTP/1.1 Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGXlK_tt1FsLE6FdDXih5anIG381k3ER1le-G8dcETyP60GGRbuNSu-zw9tTFeIN7ieaZkFj4yyrc9m9Ee-vs8AlNfC4jAqPeKyqgVHVPXscRQGu5aIUvg3rfq4NCzgmV0z5butP6Hrm9_p8X8__uUhksb_BErWLFfCVMh0fTg08e8Y Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: 01817da1260c41b4abe6f02b11c66232 Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-TestMinimumBasicScenario-1379140524 Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:23:15.585962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/01817da1260c41b4abe6f02b11c66232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/01817da1260c41b4abe6f02b11c66232"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/01817da1260c41b4abe6f02b11c66232"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_01817da1260c41b4abe6f02b11c66232"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-TestMinimumBasicScenario-1379140524 Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: 01817da1260c41b4abe6f02b11c66232 Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1379140524 Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-TestMinimumBasicScenario-1379140524-project Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 61318fafe2a1469c884b5290fe4ba366 Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-TestMinimumBasicScenario-1379140524-project Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance ff368667-d93b-4b10-9606-09331ebb857c could not be found. Aug 26 06:23:15.587743 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'ff368667-d93b-4b10-9606-09331ebb857c'} Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff368667-d93b-4b10-9606-09331ebb857c could not be found. Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:23:15.588820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff368667-d93b-4b10-9606-09331ebb857c could not be found. Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff368667-d93b-4b10-9606-09331ebb857c could not be found. Aug 26 06:23:15.590347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:15.591836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Returning 404 to user: Instance ff368667-d93b-4b10-9606-09331ebb857c could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:23:15.591836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-496624ca-0021-4a76-9309-c6445c7653b3 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c" status: 404 len: 111 microversion: 2.1 time: 0.056445 Aug 26 06:23:15.591836 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 452/899] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:15 2022] GET /compute/v2.1/servers/ff368667-d93b-4b10-9606-09331ebb857c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 06:23:15.603284 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8c476de1-dbbe-4e86-8754-7e85037190e4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] Calling method '.version_select at 0x7f2f0c97eb80>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:15.952972 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8c476de1-dbbe-4e86-8754-7e85037190e4 tempest-TestMinimumBasicScenario-1379140524 tempest-TestMinimumBasicScenario-1379140524-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1886145305" status: 202 len: 0 microversion: 2.1 time: 0.355123 Aug 26 06:23:15.953983 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 453/900] 10.222.0.40 () {58 vars in 1272 bytes} [Fri Aug 26 06:23:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1886145305 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:23:16.211943 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-27e3f25f-7afd-4ce4-ad40-bef24f21f57f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Action: 'create', calling method: .version_select at 0x7f2f090203a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1121843873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg32vLpNiBYQC0DbQh9AE2S51LjA5+0JxOgxO/9MMVKfd393QhY1hQqd1eE6s7pci/X8uBD5OP8ameQNRRIyd2P7JHTCgtgKnAk7zgANKWYPJFHy03nwOA9UhPPZCJMSA=="}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:16.240019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-27e3f25f-7afd-4ce4-ad40-bef24f21f57f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Getting quotas for project 52e8949a7d05434396f8e8631f2cdb72. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:23:16.248522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-27e3f25f-7afd-4ce4-ad40-bef24f21f57f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Getting quotas for user a9ebeec374454468aae1d2b5fde21648 and project 52e8949a7d05434396f8e8631f2cdb72. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:23:16.394769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-cf33e676-6a11-4abc-8fd1-ab28fa7a848e tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "POST /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.623845 Aug 26 06:23:16.422290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 448/901] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:23:14 2022] POST /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments => generated 194 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:16.422290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:16.422290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:16.422290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:16.424087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:16.424087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:16.424087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:16.424087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:16.424649 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:16.558267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:16.567653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:16.569689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:16.575904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c6729a36-2fea-4195-96c0-002be739504d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1406 microversion: 2.20 time: 0.174027 Aug 26 06:23:16.575904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 449/902] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:16 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:16.590994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-27e3f25f-7afd-4ce4-ad40-bef24f21f57f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.635047 Aug 26 06:23:16.591700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 454/903] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 06:23:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:16.708657 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-ff5800dc-38ba-4da4-b384-808bd95834ce req-1e970053-d689-4c1b-980a-d6bb5fe4965e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1", "tag": "eae53896-6ef9-4506-ab00-a183cb7c9907"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:16.720084 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-ff5800dc-38ba-4da4-b384-808bd95834ce req-1e970053-d689-4c1b-980a-d6bb5fe4965e service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:16.720764 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-ff5800dc-38ba-4da4-b384-808bd95834ce req-1e970053-d689-4c1b-980a-d6bb5fe4965e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:16.721378 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-ff5800dc-38ba-4da4-b384-808bd95834ce req-1e970053-d689-4c1b-980a-d6bb5fe4965e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:16.748573 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-ff5800dc-38ba-4da4-b384-808bd95834ce req-1e970053-d689-4c1b-980a-d6bb5fe4965e service nova] Creating event network-changed:eae53896-6ef9-4506-ab00-a183cb7c9907 for instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 on hv-cinder-85391 Aug 26 06:23:16.768193 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-ff5800dc-38ba-4da4-b384-808bd95834ce req-1e970053-d689-4c1b-980a-d6bb5fe4965e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063850 Aug 26 06:23:16.770032 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 450/904] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:17.598708 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:17.599307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:17.617587 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:17.618149 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:17.618565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:17.622604 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:17.625458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:17.625958 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:17.660748 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:17.916062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:17.950080 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:17.952769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:17.954350 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-297fea77-7115-4b73-864b-407dd40ceae0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1406 microversion: 2.20 time: 0.364295 Aug 26 06:23:17.967506 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 455/905] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:17 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:18.984457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:18.986961 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:18.993831 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=8 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:18.996231 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:19.002184 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:19.004117 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:19.005053 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:19.005738 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:19.006415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:19.383098 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:19.414890 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:19.418512 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:19.421950 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9b0f7da9-9b40-4354-9a87-b22bfab72b7f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1406 microversion: 2.20 time: 0.442544 Aug 26 06:23:19.439619 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 451/906] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:18 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1406 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:20.451239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:20.457750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:20.460028 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:20.460466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:20.460921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:20.461827 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:20.462378 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:20.462901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:20.671779 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:20.681721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:20.683358 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:20.684742 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a289dedc-2f1d-4dc6-91b4-2507b04f7099 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1406 microversion: 2.20 time: 0.237611 Aug 26 06:23:20.700763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 456/907] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:20 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:21.712146 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:21.712868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:21.724292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:21.724790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:21.725233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:21.726163 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:21.730690 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:21.732362 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:22.023733 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:22.041375 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:22.046749 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:22.050124 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ae1d71ba-a321-47b9-9bc6-e0c791e9be64 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1406 microversion: 2.20 time: 0.341971 Aug 26 06:23:22.052179 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 452/908] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:21 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:23.353782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:23.354755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:23.362478 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:23.363358 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:23.363804 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:23.364535 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:23.365150 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:23.365642 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:23.536280 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-88526d84-c4f8-4c1b-aaf2-04ce4e8ca4d1 req-3c024303-421b-4b15-b802-5ba53ebb60f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1", "name": "network-vif-plugged", "status": "completed", "tag": "eae53896-6ef9-4506-ab00-a183cb7c9907"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:23.553655 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-88526d84-c4f8-4c1b-aaf2-04ce4e8ca4d1 req-3c024303-421b-4b15-b802-5ba53ebb60f9 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:23.554359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-88526d84-c4f8-4c1b-aaf2-04ce4e8ca4d1 req-3c024303-421b-4b15-b802-5ba53ebb60f9 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:23.554983 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-88526d84-c4f8-4c1b-aaf2-04ce4e8ca4d1 req-3c024303-421b-4b15-b802-5ba53ebb60f9 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:23.575202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:23.576579 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:23.578024 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:23.579766 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-90a4b4a0-da79-47cd-b87a-1f3ba27d5f00 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1406 microversion: 2.20 time: 0.509616 Aug 26 06:23:23.583487 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-88526d84-c4f8-4c1b-aaf2-04ce4e8ca4d1 req-3c024303-421b-4b15-b802-5ba53ebb60f9 service nova] Creating event network-vif-plugged:eae53896-6ef9-4506-ab00-a183cb7c9907 for instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 on hv-cinder-85391 Aug 26 06:23:23.588577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 457/909] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:23 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1406 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:23.593138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-88526d84-c4f8-4c1b-aaf2-04ce4e8ca4d1 req-3c024303-421b-4b15-b802-5ba53ebb60f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061000 Aug 26 06:23:23.594174 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 453/910] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:24.617574 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:24.617574 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:24.631870 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:24.632370 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:24.632813 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:24.633537 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:24.633994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:24.634441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:24.787317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:24.804393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:24.807197 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:24.809237 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5c214a4e-cf68-415c-99d2-93bb77241319 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1406 microversion: 2.20 time: 0.200736 Aug 26 06:23:24.810223 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 458/911] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:24 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:23:25.246514 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2f80a1be-fe11-488e-b9ea-633193c759dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:25.252758 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2f80a1be-fe11-488e-b9ea-633193c759dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:25.257870 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f80a1be-fe11-488e-b9ea-633193c759dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:25.262809 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f80a1be-fe11-488e-b9ea-633193c759dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:25.262809 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f80a1be-fe11-488e-b9ea-633193c759dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:25.262809 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f80a1be-fe11-488e-b9ea-633193c759dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:25.270276 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f80a1be-fe11-488e-b9ea-633193c759dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:25.271038 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2f80a1be-fe11-488e-b9ea-633193c759dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:25.305643 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2f80a1be-fe11-488e-b9ea-633193c759dd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064167 Aug 26 06:23:25.310793 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 454/912] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:23:25 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:25.317218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-07e70396-0cbc-46cb-9ad5-c80f44056f55 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:25.317756 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-07e70396-0cbc-46cb-9ad5-c80f44056f55 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:25.323811 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07e70396-0cbc-46cb-9ad5-c80f44056f55 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:25.324294 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07e70396-0cbc-46cb-9ad5-c80f44056f55 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:25.324724 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07e70396-0cbc-46cb-9ad5-c80f44056f55 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:25.325420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07e70396-0cbc-46cb-9ad5-c80f44056f55 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:25.325878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07e70396-0cbc-46cb-9ad5-c80f44056f55 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:25.326302 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-07e70396-0cbc-46cb-9ad5-c80f44056f55 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:25.359935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-07e70396-0cbc-46cb-9ad5-c80f44056f55 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments/95241ed8-4d47-4d93-9351-b1ecca1f3567" status: 200 len: 194 microversion: 2.1 time: 0.046574 Aug 26 06:23:25.361301 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 459/913] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 26 06:23:25 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments/95241ed8-4d47-4d93-9351-b1ecca1f3567 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:25.839590 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:25.840618 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:25.851260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:25.851982 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:25.852689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:25.853791 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:25.854414 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:25.854911 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:26.085852 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:26.098860 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:26.100848 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:26.102433 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-95eb420c-1cfd-4dcf-ab92-995363fc2b81 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1406 microversion: 2.20 time: 0.268873 Aug 26 06:23:26.119150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 455/914] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:25 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:27.133970 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:27.134782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:27.150308 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:27.151533 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:27.170736 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:27.172013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:27.174151 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:27.174882 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:27.495640 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5aad398c-4804-4902-896e-b0b884bec732 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff34def2-6582-4977-9365-e4caf6e2c4b0"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:27.498155 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5aad398c-4804-4902-896e-b0b884bec732 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:27.506114 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5aad398c-4804-4902-896e-b0b884bec732 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:27.506659 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5aad398c-4804-4902-896e-b0b884bec732 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:27.507104 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5aad398c-4804-4902-896e-b0b884bec732 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:27.507915 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5aad398c-4804-4902-896e-b0b884bec732 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:27.508348 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5aad398c-4804-4902-896e-b0b884bec732 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:27.508779 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5aad398c-4804-4902-896e-b0b884bec732 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:27.521089 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:27.530121 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:27.531904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:27.538794 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0acdc658-7588-4e3b-90b7-1542c48dfb56 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1598 microversion: 2.20 time: 0.404747 Aug 26 06:23:27.538794 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 460/915] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:23:27 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1598 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:23:27.564360 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b1ddcd81-6805-4c8a-a4a5-e552f9455a1d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:27.564896 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b1ddcd81-6805-4c8a-a4a5-e552f9455a1d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:27.572199 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1ddcd81-6805-4c8a-a4a5-e552f9455a1d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:27.573713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1ddcd81-6805-4c8a-a4a5-e552f9455a1d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:27.574396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1ddcd81-6805-4c8a-a4a5-e552f9455a1d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:27.576061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1ddcd81-6805-4c8a-a4a5-e552f9455a1d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:27.577548 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1ddcd81-6805-4c8a-a4a5-e552f9455a1d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:27.578192 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1ddcd81-6805-4c8a-a4a5-e552f9455a1d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:27.617436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=4 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:27.722186 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b1ddcd81-6805-4c8a-a4a5-e552f9455a1d tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.164234 Aug 26 06:23:27.722903 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 461/916] 10.222.0.40 () {60 vars in 1316 bytes} [Fri Aug 26 06:23:27 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 06:23:28.711354 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d9e483df-dc26-486f-be43-6e728ba78ad8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:28.712000 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d9e483df-dc26-486f-be43-6e728ba78ad8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:28.718113 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d9e483df-dc26-486f-be43-6e728ba78ad8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:28.718598 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d9e483df-dc26-486f-be43-6e728ba78ad8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:28.719060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d9e483df-dc26-486f-be43-6e728ba78ad8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:28.719795 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d9e483df-dc26-486f-be43-6e728ba78ad8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:28.720973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d9e483df-dc26-486f-be43-6e728ba78ad8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:28.721412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d9e483df-dc26-486f-be43-6e728ba78ad8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:28.752522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d9e483df-dc26-486f-be43-6e728ba78ad8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Going to try to terminate instance {{(pid=121343) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:23:30.506154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d9e483df-dc26-486f-be43-6e728ba78ad8 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 204 len: 0 microversion: 2.1 time: 1.676813 Aug 26 06:23:30.506154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 462/917] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:23:28 2022] DELETE /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 0 bytes in 1678 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 06:23:30.506154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-f115cd49-c210-4250-b280-8b7599a671e5 req-de65a2b2-40af-467c-8aeb-1db47ad734c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1", "tag": "eae53896-6ef9-4506-ab00-a183cb7c9907"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:30.506154 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f115cd49-c210-4250-b280-8b7599a671e5 req-de65a2b2-40af-467c-8aeb-1db47ad734c7 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:30.509373 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f115cd49-c210-4250-b280-8b7599a671e5 req-de65a2b2-40af-467c-8aeb-1db47ad734c7 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:30.509373 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f115cd49-c210-4250-b280-8b7599a671e5 req-de65a2b2-40af-467c-8aeb-1db47ad734c7 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:30.509373 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-f115cd49-c210-4250-b280-8b7599a671e5 req-de65a2b2-40af-467c-8aeb-1db47ad734c7 service nova] Creating event network-changed:eae53896-6ef9-4506-ab00-a183cb7c9907 for instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 on hv-cinder-85391 Aug 26 06:23:30.509373 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-f115cd49-c210-4250-b280-8b7599a671e5 req-de65a2b2-40af-467c-8aeb-1db47ad734c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034829 Aug 26 06:23:30.509373 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 463/918] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:30.512253 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cec0672f-cb57-4b66-9e56-b0f75f8f164f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:30.512253 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-cec0672f-cb57-4b66-9e56-b0f75f8f164f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:30.512253 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cec0672f-cb57-4b66-9e56-b0f75f8f164f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:30.512253 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cec0672f-cb57-4b66-9e56-b0f75f8f164f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:30.513076 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cec0672f-cb57-4b66-9e56-b0f75f8f164f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:30.513076 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cec0672f-cb57-4b66-9e56-b0f75f8f164f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:30.513076 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cec0672f-cb57-4b66-9e56-b0f75f8f164f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:30.513076 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cec0672f-cb57-4b66-9e56-b0f75f8f164f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:30.626440 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5aad398c-4804-4902-896e-b0b884bec732 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "POST /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.127894 Aug 26 06:23:30.626440 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 456/919] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:23:27 2022] POST /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments => generated 194 bytes in 3130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:23:30.627158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cec0672f-cb57-4b66-9e56-b0f75f8f164f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:30.633956 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cec0672f-cb57-4b66-9e56-b0f75f8f164f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1578 microversion: 2.1 time: 0.211493 Aug 26 06:23:30.635002 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 464/920] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:30 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:31.659185 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-555728a5-1f4f-404d-ac4c-a221ed187da0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:31.659935 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-555728a5-1f4f-404d-ac4c-a221ed187da0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:31.667362 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-555728a5-1f4f-404d-ac4c-a221ed187da0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:31.667848 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-555728a5-1f4f-404d-ac4c-a221ed187da0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:31.668431 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-555728a5-1f4f-404d-ac4c-a221ed187da0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:31.669293 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-555728a5-1f4f-404d-ac4c-a221ed187da0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:31.669853 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-555728a5-1f4f-404d-ac4c-a221ed187da0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:31.670399 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-555728a5-1f4f-404d-ac4c-a221ed187da0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:31.824226 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-555728a5-1f4f-404d-ac4c-a221ed187da0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:31.832852 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-555728a5-1f4f-404d-ac4c-a221ed187da0 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1578 microversion: 2.1 time: 0.178898 Aug 26 06:23:31.848537 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 457/921] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:31 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:32.870751 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-47562e36-7407-43e4-9aad-0f4df3a71211 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:32.871368 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-47562e36-7407-43e4-9aad-0f4df3a71211 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:32.879574 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47562e36-7407-43e4-9aad-0f4df3a71211 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:32.880382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47562e36-7407-43e4-9aad-0f4df3a71211 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:32.881314 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47562e36-7407-43e4-9aad-0f4df3a71211 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:32.882307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47562e36-7407-43e4-9aad-0f4df3a71211 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:32.882861 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47562e36-7407-43e4-9aad-0f4df3a71211 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:32.883505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47562e36-7407-43e4-9aad-0f4df3a71211 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:33.083498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-47562e36-7407-43e4-9aad-0f4df3a71211 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:33.092796 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-47562e36-7407-43e4-9aad-0f4df3a71211 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1578 microversion: 2.1 time: 0.227064 Aug 26 06:23:33.093452 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 465/922] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:32 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1578 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:34.115158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ac8a0305-63f3-4a9b-a367-8f083c6843ef tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:34.115757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ac8a0305-63f3-4a9b-a367-8f083c6843ef tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:34.122219 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac8a0305-63f3-4a9b-a367-8f083c6843ef tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:34.122738 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac8a0305-63f3-4a9b-a367-8f083c6843ef tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:34.123181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac8a0305-63f3-4a9b-a367-8f083c6843ef tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:34.123872 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac8a0305-63f3-4a9b-a367-8f083c6843ef tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:34.124364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac8a0305-63f3-4a9b-a367-8f083c6843ef tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:34.124785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ac8a0305-63f3-4a9b-a367-8f083c6843ef tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:34.367994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ac8a0305-63f3-4a9b-a367-8f083c6843ef tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:34.372477 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:34.379294 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ac8a0305-63f3-4a9b-a367-8f083c6843ef tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1578 microversion: 2.1 time: 0.267909 Aug 26 06:23:34.380063 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 458/923] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:34 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1578 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:34.623896 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-99111d6e-7f5e-4a98-878f-9314382aaf90 req-7b72734e-ba07-45f9-a294-85b8cd934ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f739aa85-1e49-4e21-ab74-9463ba8ffd4c", "name": "network-vif-deleted", "tag": "61f75c3c-a587-4be9-a681-7f29d66f4b4c"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:34.656917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-99111d6e-7f5e-4a98-878f-9314382aaf90 req-7b72734e-ba07-45f9-a294-85b8cd934ab3 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:34.663120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-99111d6e-7f5e-4a98-878f-9314382aaf90 req-7b72734e-ba07-45f9-a294-85b8cd934ab3 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:34.663120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-99111d6e-7f5e-4a98-878f-9314382aaf90 req-7b72734e-ba07-45f9-a294-85b8cd934ab3 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:34.707267 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-99111d6e-7f5e-4a98-878f-9314382aaf90 req-7b72734e-ba07-45f9-a294-85b8cd934ab3 service nova] Creating event network-vif-deleted:61f75c3c-a587-4be9-a681-7f29d66f4b4c for instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c on hv-cinder-85391 Aug 26 06:23:34.728045 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-99111d6e-7f5e-4a98-878f-9314382aaf90 req-7b72734e-ba07-45f9-a294-85b8cd934ab3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108355 Aug 26 06:23:34.746481 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 466/924] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:35.412641 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1646e6f1-4cd3-4f62-9133-c3f02142815d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:35.416968 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1646e6f1-4cd3-4f62-9133-c3f02142815d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:35.421609 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1646e6f1-4cd3-4f62-9133-c3f02142815d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:35.422099 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1646e6f1-4cd3-4f62-9133-c3f02142815d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:35.422643 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1646e6f1-4cd3-4f62-9133-c3f02142815d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:35.423872 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1646e6f1-4cd3-4f62-9133-c3f02142815d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:35.424364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1646e6f1-4cd3-4f62-9133-c3f02142815d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:35.425208 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1646e6f1-4cd3-4f62-9133-c3f02142815d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:35.513730 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1646e6f1-4cd3-4f62-9133-c3f02142815d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:35.523755 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1646e6f1-4cd3-4f62-9133-c3f02142815d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1226 microversion: 2.1 time: 0.115526 Aug 26 06:23:35.534804 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 459/925] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:35 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:36.546771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:36.547699 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:36.554101 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:36.554587 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:36.555051 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:36.555751 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:36.556201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:36.556625 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:36.590371 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:36.590887 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:36.591327 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:36.591776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lazy-loading 'fault' on Instance uuid f739aa85-1e49-4e21-ab74-9463ba8ffd4c {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:23:36.636012 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:36.644695 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-97169967-3c59-4fa6-b90b-9b464dc96a8f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 200 len: 1231 microversion: 2.1 time: 0.103136 Aug 26 06:23:36.645293 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 467/926] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:36 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:37.666696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:37.667536 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:37.675285 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:37.675781 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:37.676224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:37.676928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:37.677386 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:37.677813 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:37.695743 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] HTTP exception thrown: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Request method failure captured: Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c HTTP/1.1 Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGX25XWp7tsU__iZbfd7vXbWsAXLyLrFONNJMqX0cA60pcM0k9Gh1cRXoCOz2ainB7LwOiSZU7AQhtasImzIf8Q_BLMeu_fqC_GGRfp081V9aeb6Zuc2Cz-Wjqma-QX1ALyVbuGRcVN1gQV6j2RyAo4aYYrcbneo1AD1ycfoxQ_-wP0 Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: fde0e661bd5646bab91b5e6b623a2e7e Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-TestVolumeBootPattern-727138204 Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:23:37.697505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-TestVolumeBootPattern-727138204 Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: fde0e661bd5646bab91b5e6b623a2e7e Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-TestVolumeBootPattern-727138204 Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-TestVolumeBootPattern-727138204-project Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 2f141efe3bb74587b5ba13f0cd5d89db Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-TestVolumeBootPattern-727138204-project Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:23:37.699158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'f739aa85-1e49-4e21-ab74-9463ba8ffd4c'} Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:23:37.700015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:23:37.701964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:23:37.703322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Returning 404 to user: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:23:37.703322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ed25d430-0c74-40d6-8368-25b7b8a4d590 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 404 len: 111 microversion: 2.1 time: 0.037287 Aug 26 06:23:37.703322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 460/927] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:37 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:23:37.806805 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1544959991", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1551638034", "security_groups": [{"name": "tempest-secgroup-smoke-1659315665"}], "block_device_mapping_v2": [{"uuid": "9b3be7ff-8350-4b44-85ac-7051c56a3321", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c5f68e8-9704-4e4e-a557-4e9515d804ef"}]}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:37.925700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.network.neutron [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] validate_networks() for [('6c5f68e8-9704-4e4e-a557-4e9515d804ef', None, None, None, None, None)] {{(pid=121343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:23:38.325384 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Flavor limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:23:38.326261 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Image limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:23:38.326746 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Flavor pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:23:38.327146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Image pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:23:38.327587 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:23:38.338533 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:38.339050 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:38.339489 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:38.340207 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:38.340663 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:38.341083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:38.358656 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Getting quotas for project fde0e661bd5646bab91b5e6b623a2e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:23:38.363684 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Getting quotas for user 2f141efe3bb74587b5ba13f0cd5d89db and project fde0e661bd5646bab91b5e6b623a2e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:23:38.420367 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Going to run 1 instances... {{(pid=121343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:23:38.423152 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b3be7ff-8350-4b44-85ac-7051c56a3321',volume_size=None,volume_type=None)] {{(pid=121343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:23:39.118544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-aef9fd80-c454-41a0-a512-d327885add27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.317094 Aug 26 06:23:39.119614 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 468/928] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:23:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:23:39.137619 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-62964369-1195-424b-81ba-67b940bc707e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:39.138259 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-62964369-1195-424b-81ba-67b940bc707e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:39.226800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-62964369-1195-424b-81ba-67b940bc707e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:39.226800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-62964369-1195-424b-81ba-67b940bc707e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1095 microversion: 2.1 time: 0.092457 Aug 26 06:23:39.226800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 461/929] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:39 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:40.254710 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-eda601db-0ad2-4c17-9945-7da282bc60db tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:40.255941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-eda601db-0ad2-4c17-9945-7da282bc60db tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:40.262724 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1161385888", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1121843873", "security_groups": [{"name": "tempest-secgroup-smoke-26851706"}], "networks": [{"uuid": "d008bdb5-ce3d-4b11-ad7a-76c0e477dc41"}], "block_device_mapping_v2": [{"uuid": "d1b1f9e6-2085-42b1-aa0e-a284c8d87dcb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:40.317520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-eda601db-0ad2-4c17-9945-7da282bc60db tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:40.325245 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-eda601db-0ad2-4c17-9945-7da282bc60db tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1095 microversion: 2.1 time: 0.075813 Aug 26 06:23:40.326005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 469/930] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:40 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:40.405177 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] validate_networks() for [('d008bdb5-ce3d-4b11-ad7a-76c0e477dc41', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:23:40.886933 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:23:40.887606 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:23:40.888063 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:23:40.888469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:23:40.889067 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:23:40.920446 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:40.920943 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:40.921388 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:40.922128 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:40.925694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:40.925694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:40.944310 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Getting quotas for project 52e8949a7d05434396f8e8631f2cdb72. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:23:40.949055 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Getting quotas for user a9ebeec374454468aae1d2b5fde21648 and project 52e8949a7d05434396f8e8631f2cdb72. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:23:41.015233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:23:41.018267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1b1f9e6-2085-42b1-aa0e-a284c8d87dcb',volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:23:41.351263 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-873fd8fb-4462-4b21-ab15-6cad49832994 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:41.352236 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-873fd8fb-4462-4b21-ab15-6cad49832994 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:41.360578 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-873fd8fb-4462-4b21-ab15-6cad49832994 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:41.361232 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-873fd8fb-4462-4b21-ab15-6cad49832994 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:41.362020 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-873fd8fb-4462-4b21-ab15-6cad49832994 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:41.363339 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-873fd8fb-4462-4b21-ab15-6cad49832994 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:41.364027 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-873fd8fb-4462-4b21-ab15-6cad49832994 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:41.364458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-873fd8fb-4462-4b21-ab15-6cad49832994 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:41.447037 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-873fd8fb-4462-4b21-ab15-6cad49832994 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:41.458510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-873fd8fb-4462-4b21-ab15-6cad49832994 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1137 microversion: 2.1 time: 0.113233 Aug 26 06:23:41.459411 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 470/931] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:41 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1137 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:41.537130 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f0a9c1ce-30fa-468b-a765-f23bbfe57eb2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:41.540677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f0a9c1ce-30fa-468b-a765-f23bbfe57eb2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:41.550360 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0a9c1ce-30fa-468b-a765-f23bbfe57eb2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:41.551051 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0a9c1ce-30fa-468b-a765-f23bbfe57eb2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:41.551430 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0a9c1ce-30fa-468b-a765-f23bbfe57eb2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:41.552143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0a9c1ce-30fa-468b-a765-f23bbfe57eb2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:41.552633 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0a9c1ce-30fa-468b-a765-f23bbfe57eb2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:41.553031 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0a9c1ce-30fa-468b-a765-f23bbfe57eb2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:41.590171 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f0a9c1ce-30fa-468b-a765-f23bbfe57eb2 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057349 Aug 26 06:23:41.591516 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 471/932] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:23:41 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:23:41.714232 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-de7f32e7-af64-49ed-8ce6-9c51289e0f8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.455047 Aug 26 06:23:41.716721 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 462/933] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:23:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 06:23:41.727592 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c9055b7c-e5ae-428b-b9c0-cabe6a50e48c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:41.728302 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c9055b7c-e5ae-428b-b9c0-cabe6a50e48c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:41.744178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7c9b3a7e-a8b5-446d-a156-f1e08bf6364a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:41.745119 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7c9b3a7e-a8b5-446d-a156-f1e08bf6364a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:41.758870 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c9b3a7e-a8b5-446d-a156-f1e08bf6364a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:41.759844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c9b3a7e-a8b5-446d-a156-f1e08bf6364a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:41.760794 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c9b3a7e-a8b5-446d-a156-f1e08bf6364a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:41.762655 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c9b3a7e-a8b5-446d-a156-f1e08bf6364a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:41.764173 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c9b3a7e-a8b5-446d-a156-f1e08bf6364a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:41.765263 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7c9b3a7e-a8b5-446d-a156-f1e08bf6364a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:41.795795 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c9055b7c-e5ae-428b-b9c0-cabe6a50e48c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:41.805975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c9055b7c-e5ae-428b-b9c0-cabe6a50e48c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1089 microversion: 2.1 time: 0.082274 Aug 26 06:23:41.806795 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 472/934] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:41 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1089 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:41.816846 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7c9b3a7e-a8b5-446d-a156-f1e08bf6364a tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments/95241ed8-4d47-4d93-9351-b1ecca1f3567" status: 200 len: 194 microversion: 2.1 time: 0.078112 Aug 26 06:23:41.817706 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 463/935] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 26 06:23:41 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments/95241ed8-4d47-4d93-9351-b1ecca1f3567 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:41.832604 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e658ccce-6de3-41cf-ad9b-6eb32dd5eed0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:41.833553 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e658ccce-6de3-41cf-ad9b-6eb32dd5eed0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:41.844777 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e658ccce-6de3-41cf-ad9b-6eb32dd5eed0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:41.852769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e658ccce-6de3-41cf-ad9b-6eb32dd5eed0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:41.852769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e658ccce-6de3-41cf-ad9b-6eb32dd5eed0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:41.852769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e658ccce-6de3-41cf-ad9b-6eb32dd5eed0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:41.852769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e658ccce-6de3-41cf-ad9b-6eb32dd5eed0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:41.853257 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e658ccce-6de3-41cf-ad9b-6eb32dd5eed0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:41.961782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-e658ccce-6de3-41cf-ad9b-6eb32dd5eed0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lazy-loading 'services' on Instance uuid 718e8607-e647-40b3-aa7d-16d5f5cd577d {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:23:42.175451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:42.335898 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e658ccce-6de3-41cf-ad9b-6eb32dd5eed0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "DELETE /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments/95241ed8-4d47-4d93-9351-b1ecca1f3567" status: 202 len: 0 microversion: 2.1 time: 0.510565 Aug 26 06:23:42.336803 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 473/936] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:23:41 2022] DELETE /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments/95241ed8-4d47-4d93-9351-b1ecca1f3567 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:23:42.480965 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6e30e6f9-740a-4669-94a7-1a8d1525f166 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:42.482484 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6e30e6f9-740a-4669-94a7-1a8d1525f166 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:42.491341 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e30e6f9-740a-4669-94a7-1a8d1525f166 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:42.491901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e30e6f9-740a-4669-94a7-1a8d1525f166 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:42.492541 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e30e6f9-740a-4669-94a7-1a8d1525f166 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:42.493121 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e30e6f9-740a-4669-94a7-1a8d1525f166 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:42.493758 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e30e6f9-740a-4669-94a7-1a8d1525f166 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:42.494183 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6e30e6f9-740a-4669-94a7-1a8d1525f166 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:42.811863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6e30e6f9-740a-4669-94a7-1a8d1525f166 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:42.821115 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6e30e6f9-740a-4669-94a7-1a8d1525f166 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1201 microversion: 2.1 time: 0.344046 Aug 26 06:23:42.822001 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 464/937] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:42 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1201 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:42.837048 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e4c0a301-bebb-43ec-8ec0-dca2c5c6eae5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:42.837048 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e4c0a301-bebb-43ec-8ec0-dca2c5c6eae5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:42.896162 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e4c0a301-bebb-43ec-8ec0-dca2c5c6eae5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:42.903695 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e4c0a301-bebb-43ec-8ec0-dca2c5c6eae5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1089 microversion: 2.1 time: 0.079235 Aug 26 06:23:42.904264 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 474/938] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:42 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:43.845231 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9adc87df-a422-472b-a942-c8cace4035b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:43.853247 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9adc87df-a422-472b-a942-c8cace4035b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:43.859066 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9adc87df-a422-472b-a942-c8cace4035b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:43.860860 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9adc87df-a422-472b-a942-c8cace4035b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:43.861505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9adc87df-a422-472b-a942-c8cace4035b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:43.862571 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9adc87df-a422-472b-a942-c8cace4035b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:43.863147 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9adc87df-a422-472b-a942-c8cace4035b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:43.863346 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9adc87df-a422-472b-a942-c8cace4035b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:43.927544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ddccf0c9-3c97-4194-8964-d2dbc252c383 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:43.929704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ddccf0c9-3c97-4194-8964-d2dbc252c383 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:44.007712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ddccf0c9-3c97-4194-8964-d2dbc252c383 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:44.016551 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ddccf0c9-3c97-4194-8964-d2dbc252c383 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1089 microversion: 2.1 time: 0.094900 Aug 26 06:23:44.017237 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 475/939] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:43 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1089 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:23:44.088203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9adc87df-a422-472b-a942-c8cace4035b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:44.097557 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9adc87df-a422-472b-a942-c8cace4035b3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1279 microversion: 2.1 time: 0.257460 Aug 26 06:23:44.098331 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 465/940] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:43 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1279 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:44.531191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-18971983-891e-4139-b0b7-51959cd1382d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:44.531819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-18971983-891e-4139-b0b7-51959cd1382d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:44.542340 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18971983-891e-4139-b0b7-51959cd1382d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:44.543094 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18971983-891e-4139-b0b7-51959cd1382d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:44.544155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18971983-891e-4139-b0b7-51959cd1382d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:44.545307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18971983-891e-4139-b0b7-51959cd1382d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:44.546439 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18971983-891e-4139-b0b7-51959cd1382d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:44.547060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-18971983-891e-4139-b0b7-51959cd1382d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:44.587589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-18971983-891e-4139-b0b7-51959cd1382d tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments/ff34def2-6582-4977-9365-e4caf6e2c4b0" status: 200 len: 194 microversion: 2.1 time: 0.061765 Aug 26 06:23:44.588198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 476/941] 10.222.0.40 () {58 vars in 1413 bytes} [Fri Aug 26 06:23:44 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments/ff34def2-6582-4977-9365-e4caf6e2c4b0 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:44.599614 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e6220344-f2f1-4998-966b-f5764b8060d0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:44.600166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e6220344-f2f1-4998-966b-f5764b8060d0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:44.606827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6220344-f2f1-4998-966b-f5764b8060d0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:44.608630 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6220344-f2f1-4998-966b-f5764b8060d0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:44.609484 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6220344-f2f1-4998-966b-f5764b8060d0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:44.611143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6220344-f2f1-4998-966b-f5764b8060d0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:44.611605 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6220344-f2f1-4998-966b-f5764b8060d0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:44.612039 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e6220344-f2f1-4998-966b-f5764b8060d0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:44.703012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-e6220344-f2f1-4998-966b-f5764b8060d0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lazy-loading 'services' on Instance uuid 718e8607-e647-40b3-aa7d-16d5f5cd577d {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:23:45.037712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d7a3cdf8-b984-4a16-8276-9479de0f1e8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:45.038584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d7a3cdf8-b984-4a16-8276-9479de0f1e8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:45.042081 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:45.045680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7a3cdf8-b984-4a16-8276-9479de0f1e8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:45.046342 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7a3cdf8-b984-4a16-8276-9479de0f1e8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:45.048962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7a3cdf8-b984-4a16-8276-9479de0f1e8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:45.048962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7a3cdf8-b984-4a16-8276-9479de0f1e8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:45.048962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7a3cdf8-b984-4a16-8276-9479de0f1e8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:45.049389 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7a3cdf8-b984-4a16-8276-9479de0f1e8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:45.115002 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d7a3cdf8-b984-4a16-8276-9479de0f1e8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:45.122952 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d7a3cdf8-b984-4a16-8276-9479de0f1e8f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1131 microversion: 2.1 time: 0.089028 Aug 26 06:23:45.123549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 477/942] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:45 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1131 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:23:45.128709 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-47d5e47b-378a-4f1d-b7b6-8d9469365779 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:45.129303 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-47d5e47b-378a-4f1d-b7b6-8d9469365779 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:45.134792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47d5e47b-378a-4f1d-b7b6-8d9469365779 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:45.135329 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47d5e47b-378a-4f1d-b7b6-8d9469365779 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:45.135760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47d5e47b-378a-4f1d-b7b6-8d9469365779 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:45.136439 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47d5e47b-378a-4f1d-b7b6-8d9469365779 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:45.136958 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47d5e47b-378a-4f1d-b7b6-8d9469365779 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:45.137423 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-47d5e47b-378a-4f1d-b7b6-8d9469365779 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:45.224602 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e6220344-f2f1-4998-966b-f5764b8060d0 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "DELETE /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments/ff34def2-6582-4977-9365-e4caf6e2c4b0" status: 202 len: 0 microversion: 2.1 time: 0.629020 Aug 26 06:23:45.225205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 466/943] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:23:44 2022] DELETE /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments/ff34def2-6582-4977-9365-e4caf6e2c4b0 => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:23:45.238688 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-48047a9d-197a-4c74-941f-8adaaca528be req-b58c924d-ffa1-46c8-939b-5d675366e136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce4ec4be-d09b-431b-93f0-062334195c69", "tag": "07d50961-0e64-446f-a7b3-9104f5a9a451"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:45.254155 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-48047a9d-197a-4c74-941f-8adaaca528be req-b58c924d-ffa1-46c8-939b-5d675366e136 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:45.254989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-48047a9d-197a-4c74-941f-8adaaca528be req-b58c924d-ffa1-46c8-939b-5d675366e136 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:45.255630 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-48047a9d-197a-4c74-941f-8adaaca528be req-b58c924d-ffa1-46c8-939b-5d675366e136 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:45.270069 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-48047a9d-197a-4c74-941f-8adaaca528be req-b58c924d-ffa1-46c8-939b-5d675366e136 service nova] Creating event network-changed:07d50961-0e64-446f-a7b3-9104f5a9a451 for instance ce4ec4be-d09b-431b-93f0-062334195c69 on hv-cinder-85391 Aug 26 06:23:45.275716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-48047a9d-197a-4c74-941f-8adaaca528be req-b58c924d-ffa1-46c8-939b-5d675366e136 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048783 Aug 26 06:23:45.276863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 467/944] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:45.305146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-47d5e47b-378a-4f1d-b7b6-8d9469365779 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:45.326159 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-47d5e47b-378a-4f1d-b7b6-8d9469365779 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1279 microversion: 2.1 time: 0.201383 Aug 26 06:23:45.327068 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 478/945] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:45 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1279 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:46.145362 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4dcfa5b3-1680-4e95-9dcb-6e76cc1c06e2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:46.146111 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4dcfa5b3-1680-4e95-9dcb-6e76cc1c06e2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:46.159610 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4dcfa5b3-1680-4e95-9dcb-6e76cc1c06e2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:46.160492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4dcfa5b3-1680-4e95-9dcb-6e76cc1c06e2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:46.162023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4dcfa5b3-1680-4e95-9dcb-6e76cc1c06e2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:46.164528 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4dcfa5b3-1680-4e95-9dcb-6e76cc1c06e2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:46.165210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4dcfa5b3-1680-4e95-9dcb-6e76cc1c06e2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:46.167918 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4dcfa5b3-1680-4e95-9dcb-6e76cc1c06e2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:46.284653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4dcfa5b3-1680-4e95-9dcb-6e76cc1c06e2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:46.292929 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4dcfa5b3-1680-4e95-9dcb-6e76cc1c06e2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1187 microversion: 2.1 time: 0.152843 Aug 26 06:23:46.293491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 468/946] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:46 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1187 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:46.349417 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-89072bca-11d9-4aa6-aa02-842dd6347663 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:46.350752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-89072bca-11d9-4aa6-aa02-842dd6347663 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:46.358459 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89072bca-11d9-4aa6-aa02-842dd6347663 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:46.359185 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89072bca-11d9-4aa6-aa02-842dd6347663 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:46.365047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89072bca-11d9-4aa6-aa02-842dd6347663 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:46.365047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89072bca-11d9-4aa6-aa02-842dd6347663 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:46.365047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89072bca-11d9-4aa6-aa02-842dd6347663 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:46.365047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-89072bca-11d9-4aa6-aa02-842dd6347663 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:46.507597 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-89072bca-11d9-4aa6-aa02-842dd6347663 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:46.515180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-89072bca-11d9-4aa6-aa02-842dd6347663 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1279 microversion: 2.1 time: 0.169868 Aug 26 06:23:46.520645 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 479/947] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:46 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:47.313743 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d926ffe2-e5a8-4233-9595-13edc822cfef tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:47.314505 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d926ffe2-e5a8-4233-9595-13edc822cfef tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:47.316771 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:47.321534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d926ffe2-e5a8-4233-9595-13edc822cfef tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:47.322007 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d926ffe2-e5a8-4233-9595-13edc822cfef tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:47.322442 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d926ffe2-e5a8-4233-9595-13edc822cfef tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:47.323166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d926ffe2-e5a8-4233-9595-13edc822cfef tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:47.323618 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d926ffe2-e5a8-4233-9595-13edc822cfef tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:47.324043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d926ffe2-e5a8-4233-9595-13edc822cfef tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:47.399052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d926ffe2-e5a8-4233-9595-13edc822cfef tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:47.402598 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d926ffe2-e5a8-4233-9595-13edc822cfef tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1205 microversion: 2.1 time: 0.093216 Aug 26 06:23:47.403187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 469/948] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:47 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1205 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:47.537512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-10730064-5efb-4d8a-9d30-cdf67a7cd5da tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:47.538369 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-10730064-5efb-4d8a-9d30-cdf67a7cd5da tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:47.545509 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-10730064-5efb-4d8a-9d30-cdf67a7cd5da tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:47.545994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-10730064-5efb-4d8a-9d30-cdf67a7cd5da tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:47.546435 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-10730064-5efb-4d8a-9d30-cdf67a7cd5da tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:47.547689 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-10730064-5efb-4d8a-9d30-cdf67a7cd5da tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:47.548153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-10730064-5efb-4d8a-9d30-cdf67a7cd5da tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:47.548583 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-10730064-5efb-4d8a-9d30-cdf67a7cd5da tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:47.683554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-10730064-5efb-4d8a-9d30-cdf67a7cd5da tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:47.692469 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-10730064-5efb-4d8a-9d30-cdf67a7cd5da tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.159293 Aug 26 06:23:47.693044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 480/949] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:47 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:23:48.017981 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0678c22f-aa88-4d6f-8b78-0bcd7a4952ac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:48.021739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0678c22f-aa88-4d6f-8b78-0bcd7a4952ac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:48.033400 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0678c22f-aa88-4d6f-8b78-0bcd7a4952ac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:48.033400 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0678c22f-aa88-4d6f-8b78-0bcd7a4952ac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:48.033400 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0678c22f-aa88-4d6f-8b78-0bcd7a4952ac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:48.034276 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0678c22f-aa88-4d6f-8b78-0bcd7a4952ac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:48.035056 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0678c22f-aa88-4d6f-8b78-0bcd7a4952ac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:48.035637 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0678c22f-aa88-4d6f-8b78-0bcd7a4952ac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:48.068957 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0678c22f-aa88-4d6f-8b78-0bcd7a4952ac tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055291 Aug 26 06:23:48.069508 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 470/950] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:23:48 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 06:23:48.346210 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7d1ae7d2-48e2-49d2-8063-fcc815436d06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:48.349339 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7d1ae7d2-48e2-49d2-8063-fcc815436d06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:48.351355 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:48.356480 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d1ae7d2-48e2-49d2-8063-fcc815436d06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:48.357175 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d1ae7d2-48e2-49d2-8063-fcc815436d06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:48.357613 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d1ae7d2-48e2-49d2-8063-fcc815436d06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:48.358370 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d1ae7d2-48e2-49d2-8063-fcc815436d06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:48.358873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d1ae7d2-48e2-49d2-8063-fcc815436d06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:48.359329 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7d1ae7d2-48e2-49d2-8063-fcc815436d06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:48.391427 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7d1ae7d2-48e2-49d2-8063-fcc815436d06 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052167 Aug 26 06:23:48.392294 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 481/951] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:23:48 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 06:23:48.425688 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6a7b48bd-8b59-4c14-9f13-851820329c77 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:48.426326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6a7b48bd-8b59-4c14-9f13-851820329c77 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:48.433354 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a7b48bd-8b59-4c14-9f13-851820329c77 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:48.445430 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a7b48bd-8b59-4c14-9f13-851820329c77 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:48.445972 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a7b48bd-8b59-4c14-9f13-851820329c77 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:48.446813 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a7b48bd-8b59-4c14-9f13-851820329c77 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:48.451101 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a7b48bd-8b59-4c14-9f13-851820329c77 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:48.454542 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a7b48bd-8b59-4c14-9f13-851820329c77 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:48.463723 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-1ebe49e0-bb9e-4b5f-86e4-172da590aebd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:48.464214 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1ebe49e0-bb9e-4b5f-86e4-172da590aebd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:48.472305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ebe49e0-bb9e-4b5f-86e4-172da590aebd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:48.472750 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ebe49e0-bb9e-4b5f-86e4-172da590aebd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:48.473400 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ebe49e0-bb9e-4b5f-86e4-172da590aebd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:48.474293 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ebe49e0-bb9e-4b5f-86e4-172da590aebd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:48.474924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ebe49e0-bb9e-4b5f-86e4-172da590aebd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:48.475521 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ebe49e0-bb9e-4b5f-86e4-172da590aebd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:48.505818 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1ebe49e0-bb9e-4b5f-86e4-172da590aebd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Going to try to terminate instance {{(pid=121343) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:23:48.722924 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6a7b48bd-8b59-4c14-9f13-851820329c77 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:48.732119 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6a7b48bd-8b59-4c14-9f13-851820329c77 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1271 microversion: 2.1 time: 0.312349 Aug 26 06:23:48.733247 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 471/952] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:48 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1271 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:48.749000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-366358c0-34ed-4202-b370-d2e07f85344f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:48.749636 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-366358c0-34ed-4202-b370-d2e07f85344f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:48.756318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-366358c0-34ed-4202-b370-d2e07f85344f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:48.756800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-366358c0-34ed-4202-b370-d2e07f85344f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:48.757417 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-366358c0-34ed-4202-b370-d2e07f85344f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:48.758128 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-366358c0-34ed-4202-b370-d2e07f85344f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:48.758585 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-366358c0-34ed-4202-b370-d2e07f85344f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:48.759048 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-366358c0-34ed-4202-b370-d2e07f85344f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:48.959436 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-366358c0-34ed-4202-b370-d2e07f85344f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:48.967520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-366358c0-34ed-4202-b370-d2e07f85344f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.233056 Aug 26 06:23:48.968075 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 472/953] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:48 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:49.089101 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-1ebe49e0-bb9e-4b5f-86e4-172da590aebd tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "DELETE /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 204 len: 0 microversion: 2.1 time: 0.629702 Aug 26 06:23:49.090392 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 482/954] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:23:48 2022] DELETE /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 0 bytes in 632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 06:23:49.104671 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b7a9e12d-358e-4a63-bf14-6aa8759737b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:49.105829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b7a9e12d-358e-4a63-bf14-6aa8759737b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:49.116488 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7a9e12d-358e-4a63-bf14-6aa8759737b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:49.117376 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7a9e12d-358e-4a63-bf14-6aa8759737b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:49.118190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7a9e12d-358e-4a63-bf14-6aa8759737b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:49.119489 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7a9e12d-358e-4a63-bf14-6aa8759737b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:49.120453 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7a9e12d-358e-4a63-bf14-6aa8759737b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:49.121225 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b7a9e12d-358e-4a63-bf14-6aa8759737b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:49.345964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b7a9e12d-358e-4a63-bf14-6aa8759737b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:49.354891 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b7a9e12d-358e-4a63-bf14-6aa8759737b5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1671 microversion: 2.1 time: 0.257667 Aug 26 06:23:49.355689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 473/955] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:49 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1671 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:23:49.560149 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-f931d384-30cb-449b-a996-d0328678c420 req-8ee98dfb-9e9a-4231-980c-375294a8e01b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4228acc2-99a7-47c3-9cef-92c0f7bcb7b0", "tag": "16e251e3-f929-404a-95a5-e7b555e4782f"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:49.570883 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f931d384-30cb-449b-a996-d0328678c420 req-8ee98dfb-9e9a-4231-980c-375294a8e01b service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:49.571503 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f931d384-30cb-449b-a996-d0328678c420 req-8ee98dfb-9e9a-4231-980c-375294a8e01b service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:49.571937 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-f931d384-30cb-449b-a996-d0328678c420 req-8ee98dfb-9e9a-4231-980c-375294a8e01b service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:49.585832 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-f931d384-30cb-449b-a996-d0328678c420 req-8ee98dfb-9e9a-4231-980c-375294a8e01b service nova] Creating event network-changed:16e251e3-f929-404a-95a5-e7b555e4782f for instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 on hv-cinder-85391 Aug 26 06:23:49.590556 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-f931d384-30cb-449b-a996-d0328678c420 req-8ee98dfb-9e9a-4231-980c-375294a8e01b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034410 Aug 26 06:23:49.591059 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 483/956] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:49.753610 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e5de1b10-9316-447c-aa96-f81dc7c81327 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:49.754232 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e5de1b10-9316-447c-aa96-f81dc7c81327 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:49.761164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5de1b10-9316-447c-aa96-f81dc7c81327 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:49.761651 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5de1b10-9316-447c-aa96-f81dc7c81327 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:49.762186 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5de1b10-9316-447c-aa96-f81dc7c81327 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:49.762931 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5de1b10-9316-447c-aa96-f81dc7c81327 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:49.763392 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5de1b10-9316-447c-aa96-f81dc7c81327 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:49.763885 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e5de1b10-9316-447c-aa96-f81dc7c81327 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:49.896557 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e5de1b10-9316-447c-aa96-f81dc7c81327 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:49.905069 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e5de1b10-9316-447c-aa96-f81dc7c81327 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1271 microversion: 2.1 time: 0.156348 Aug 26 06:23:49.905637 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 474/957] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:49 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:49.991054 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5879da45-9b23-421a-a03d-26a48fa8d3f5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:49.991904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5879da45-9b23-421a-a03d-26a48fa8d3f5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:49.998494 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5879da45-9b23-421a-a03d-26a48fa8d3f5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:49.999011 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5879da45-9b23-421a-a03d-26a48fa8d3f5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:49.999505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5879da45-9b23-421a-a03d-26a48fa8d3f5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:50.000173 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5879da45-9b23-421a-a03d-26a48fa8d3f5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:50.001145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5879da45-9b23-421a-a03d-26a48fa8d3f5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:50.001329 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5879da45-9b23-421a-a03d-26a48fa8d3f5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:50.140107 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5879da45-9b23-421a-a03d-26a48fa8d3f5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:50.147937 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5879da45-9b23-421a-a03d-26a48fa8d3f5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.161438 Aug 26 06:23:50.149679 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 484/958] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:49 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:50.377401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ab761c8f-6eb7-45d6-9ab7-5fff6e110f32 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:50.378008 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ab761c8f-6eb7-45d6-9ab7-5fff6e110f32 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:50.384004 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab761c8f-6eb7-45d6-9ab7-5fff6e110f32 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:50.384484 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab761c8f-6eb7-45d6-9ab7-5fff6e110f32 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:50.384917 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab761c8f-6eb7-45d6-9ab7-5fff6e110f32 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:50.385650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab761c8f-6eb7-45d6-9ab7-5fff6e110f32 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:50.386052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab761c8f-6eb7-45d6-9ab7-5fff6e110f32 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:50.386528 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab761c8f-6eb7-45d6-9ab7-5fff6e110f32 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:50.525608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ab761c8f-6eb7-45d6-9ab7-5fff6e110f32 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:50.534178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ab761c8f-6eb7-45d6-9ab7-5fff6e110f32 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1671 microversion: 2.1 time: 0.161365 Aug 26 06:23:50.534769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 475/959] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:50 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:50.926404 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a000d7f4-bee9-4828-bdd1-bd60635f0758 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:50.927173 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a000d7f4-bee9-4828-bdd1-bd60635f0758 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:50.934680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a000d7f4-bee9-4828-bdd1-bd60635f0758 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:50.935276 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a000d7f4-bee9-4828-bdd1-bd60635f0758 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:50.936031 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a000d7f4-bee9-4828-bdd1-bd60635f0758 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:50.936853 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a000d7f4-bee9-4828-bdd1-bd60635f0758 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:50.937385 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a000d7f4-bee9-4828-bdd1-bd60635f0758 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:50.938384 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a000d7f4-bee9-4828-bdd1-bd60635f0758 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:51.177815 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a2d394c0-d973-4c86-89b4-d2a869d5ee24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:51.179577 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a2d394c0-d973-4c86-89b4-d2a869d5ee24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:51.186472 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:51.189691 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=8 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:51.194697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a2d394c0-d973-4c86-89b4-d2a869d5ee24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:51.195582 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a2d394c0-d973-4c86-89b4-d2a869d5ee24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:51.196238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a2d394c0-d973-4c86-89b4-d2a869d5ee24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:51.197366 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a2d394c0-d973-4c86-89b4-d2a869d5ee24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:51.197933 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a2d394c0-d973-4c86-89b4-d2a869d5ee24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:51.198591 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a2d394c0-d973-4c86-89b4-d2a869d5ee24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:51.206186 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a000d7f4-bee9-4828-bdd1-bd60635f0758 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:51.216221 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a000d7f4-bee9-4828-bdd1-bd60635f0758 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1271 microversion: 2.1 time: 0.294538 Aug 26 06:23:51.216790 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 485/960] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:50 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1271 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:51.447521 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a2d394c0-d973-4c86-89b4-d2a869d5ee24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:51.460237 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a2d394c0-d973-4c86-89b4-d2a869d5ee24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.288454 Aug 26 06:23:51.461170 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 476/961] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:51 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:51.556099 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8b1baac5-351f-47ea-ad14-1724997a30a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:51.556837 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8b1baac5-351f-47ea-ad14-1724997a30a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:51.563441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8b1baac5-351f-47ea-ad14-1724997a30a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:51.566105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8b1baac5-351f-47ea-ad14-1724997a30a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:51.566105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8b1baac5-351f-47ea-ad14-1724997a30a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:51.566105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8b1baac5-351f-47ea-ad14-1724997a30a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:51.566105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8b1baac5-351f-47ea-ad14-1724997a30a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:51.566572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8b1baac5-351f-47ea-ad14-1724997a30a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:51.701059 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-8b1baac5-351f-47ea-ad14-1724997a30a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:51.709732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8b1baac5-351f-47ea-ad14-1724997a30a5 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1671 microversion: 2.1 time: 0.157447 Aug 26 06:23:51.710310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 486/962] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:51 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:52.104543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-814b8599-3787-48a1-8afb-a7b03fc2fdec req-403f716e-ba03-43a1-8d65-82aca7e84a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718e8607-e647-40b3-aa7d-16d5f5cd577d", "name": "network-vif-deleted", "tag": "1c3c5d78-83bd-44bb-94cf-b0a7843f9fc7"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:23:52.115239 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-814b8599-3787-48a1-8afb-a7b03fc2fdec req-403f716e-ba03-43a1-8d65-82aca7e84a14 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:52.116804 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-814b8599-3787-48a1-8afb-a7b03fc2fdec req-403f716e-ba03-43a1-8d65-82aca7e84a14 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:52.117255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-814b8599-3787-48a1-8afb-a7b03fc2fdec req-403f716e-ba03-43a1-8d65-82aca7e84a14 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:52.131486 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-814b8599-3787-48a1-8afb-a7b03fc2fdec req-403f716e-ba03-43a1-8d65-82aca7e84a14 service nova] Creating event network-vif-deleted:1c3c5d78-83bd-44bb-94cf-b0a7843f9fc7 for instance 718e8607-e647-40b3-aa7d-16d5f5cd577d on hv-cinder-85391 Aug 26 06:23:52.137820 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-814b8599-3787-48a1-8afb-a7b03fc2fdec req-403f716e-ba03-43a1-8d65-82aca7e84a14 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037480 Aug 26 06:23:52.142008 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 477/963] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:23:52.237964 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a310c555-ee61-4ac8-9078-0696d2f89521 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:52.238801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a310c555-ee61-4ac8-9078-0696d2f89521 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:52.246437 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a310c555-ee61-4ac8-9078-0696d2f89521 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:52.246957 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a310c555-ee61-4ac8-9078-0696d2f89521 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:52.247387 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a310c555-ee61-4ac8-9078-0696d2f89521 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:52.248085 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a310c555-ee61-4ac8-9078-0696d2f89521 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:52.248534 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a310c555-ee61-4ac8-9078-0696d2f89521 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:52.249138 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a310c555-ee61-4ac8-9078-0696d2f89521 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:52.409838 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a310c555-ee61-4ac8-9078-0696d2f89521 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:52.418384 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a310c555-ee61-4ac8-9078-0696d2f89521 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1259 microversion: 2.1 time: 0.184780 Aug 26 06:23:52.423361 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 487/964] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:52 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:52.483522 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-48ab5503-9b38-4c8b-866c-00218ea3985e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:52.484228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-48ab5503-9b38-4c8b-866c-00218ea3985e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:52.490774 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48ab5503-9b38-4c8b-866c-00218ea3985e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:52.491272 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48ab5503-9b38-4c8b-866c-00218ea3985e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:52.491716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48ab5503-9b38-4c8b-866c-00218ea3985e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:52.492427 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48ab5503-9b38-4c8b-866c-00218ea3985e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:52.492884 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48ab5503-9b38-4c8b-866c-00218ea3985e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:52.493311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-48ab5503-9b38-4c8b-866c-00218ea3985e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:52.514570 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:52.652811 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-48ab5503-9b38-4c8b-866c-00218ea3985e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:52.660978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-48ab5503-9b38-4c8b-866c-00218ea3985e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.182138 Aug 26 06:23:52.661888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 478/965] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:52 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:52.732707 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-68f92fb2-1376-40c5-b1ac-34d7714ac19b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:52.733316 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-68f92fb2-1376-40c5-b1ac-34d7714ac19b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:52.739638 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68f92fb2-1376-40c5-b1ac-34d7714ac19b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:52.740128 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68f92fb2-1376-40c5-b1ac-34d7714ac19b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:52.740557 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68f92fb2-1376-40c5-b1ac-34d7714ac19b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:52.741262 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68f92fb2-1376-40c5-b1ac-34d7714ac19b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:52.741706 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68f92fb2-1376-40c5-b1ac-34d7714ac19b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:52.742133 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-68f92fb2-1376-40c5-b1ac-34d7714ac19b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:52.813296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-68f92fb2-1376-40c5-b1ac-34d7714ac19b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:52.822172 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-68f92fb2-1376-40c5-b1ac-34d7714ac19b tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1321 microversion: 2.1 time: 0.093923 Aug 26 06:23:52.822896 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 488/966] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:52 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1321 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:53.440053 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c1b4fd13-574f-4f78-9ca2-4a76a6fa17f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:53.440912 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c1b4fd13-574f-4f78-9ca2-4a76a6fa17f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:53.448206 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd13-574f-4f78-9ca2-4a76a6fa17f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:53.448701 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd13-574f-4f78-9ca2-4a76a6fa17f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:53.449148 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd13-574f-4f78-9ca2-4a76a6fa17f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:53.449854 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd13-574f-4f78-9ca2-4a76a6fa17f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:53.450326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd13-574f-4f78-9ca2-4a76a6fa17f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:53.450798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd13-574f-4f78-9ca2-4a76a6fa17f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:53.595521 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c1b4fd13-574f-4f78-9ca2-4a76a6fa17f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:53.610801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c1b4fd13-574f-4f78-9ca2-4a76a6fa17f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1259 microversion: 2.1 time: 0.174951 Aug 26 06:23:53.611515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 479/967] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:53 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:53.682537 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-05b6ad89-5b8d-4470-977a-31c125604c66 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:53.683166 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-05b6ad89-5b8d-4470-977a-31c125604c66 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:53.689884 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b6ad89-5b8d-4470-977a-31c125604c66 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:53.690391 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b6ad89-5b8d-4470-977a-31c125604c66 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:53.690846 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b6ad89-5b8d-4470-977a-31c125604c66 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:53.691539 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b6ad89-5b8d-4470-977a-31c125604c66 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:53.691984 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b6ad89-5b8d-4470-977a-31c125604c66 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:53.692524 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-05b6ad89-5b8d-4470-977a-31c125604c66 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:53.837689 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-05b6ad89-5b8d-4470-977a-31c125604c66 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:53.845735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:53.846477 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:53.852598 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:53.853094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:53.853231 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-05b6ad89-5b8d-4470-977a-31c125604c66 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.174295 Aug 26 06:23:53.853639 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:53.855772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:53.855933 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 489/968] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:53 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:53.856035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:53.856035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:53.887975 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:53.888462 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:53.888897 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:53.889342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lazy-loading 'fault' on Instance uuid 718e8607-e647-40b3-aa7d-16d5f5cd577d {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:23:53.935083 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d22ea3fb8fa4bd99537fb83279b2d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aceecfa04cf941348d542c3e55569384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:53.944389 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6a02fa65-c8ac-4e46-b47b-29de3bacdc8f tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 200 len: 1326 microversion: 2.1 time: 0.104583 Aug 26 06:23:53.947992 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 480/969] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:53 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:23:54.635691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-daa458c9-16d3-44e2-b616-4cced9ad32b6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:54.636473 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-daa458c9-16d3-44e2-b616-4cced9ad32b6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:54.638910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=14 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:54.644060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-daa458c9-16d3-44e2-b616-4cced9ad32b6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:54.644546 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-daa458c9-16d3-44e2-b616-4cced9ad32b6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:54.644981 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-daa458c9-16d3-44e2-b616-4cced9ad32b6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:54.645701 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-daa458c9-16d3-44e2-b616-4cced9ad32b6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:54.646206 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-daa458c9-16d3-44e2-b616-4cced9ad32b6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:54.646654 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-daa458c9-16d3-44e2-b616-4cced9ad32b6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:54.785348 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-daa458c9-16d3-44e2-b616-4cced9ad32b6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:54.793176 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-daa458c9-16d3-44e2-b616-4cced9ad32b6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1259 microversion: 2.1 time: 0.161637 Aug 26 06:23:54.793731 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 490/970] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:54 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:54.893475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ccfe9359-051e-4c8e-a79a-c351aae79a0d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:54.894025 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ccfe9359-051e-4c8e-a79a-c351aae79a0d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:54.900919 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccfe9359-051e-4c8e-a79a-c351aae79a0d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:54.901404 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccfe9359-051e-4c8e-a79a-c351aae79a0d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:54.901848 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccfe9359-051e-4c8e-a79a-c351aae79a0d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:54.902545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccfe9359-051e-4c8e-a79a-c351aae79a0d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:54.903035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccfe9359-051e-4c8e-a79a-c351aae79a0d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:54.903465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccfe9359-051e-4c8e-a79a-c351aae79a0d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:54.968602 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:54.969885 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:54.975914 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:54.976398 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:54.976832 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:54.977663 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:54.977983 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:54.978412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:54.991952 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] HTTP exception thrown: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Request method failure captured: Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d HTTP/1.1 Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGVEi2sDXAvdvv0HOjOhYG6O-5VK8zNRXflkr7zgg20kn-Pl3aXACI09HI_Bzo_JAoPt_SKluW9p9eIX44jqqougK0jcKZduIAPehwvlKYPagzLHHrZ77XFhCi8EgJB16YzWV-h6lpMKhj3GrHQboIpM60heVYH7Z-nR8p0FfSXnXfs Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:23:54.993627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aceecfa04cf941348d542c3e55569384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aceecfa04cf941348d542c3e55569384"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 1d22ea3fb8fa4bd99537fb83279b2d24 Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:23:54.995239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': '718e8607-e647-40b3-aa7d-16d5f5cd577d'} Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:23:54.996127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:23:54.997690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:23:54.999494 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Returning 404 to user: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:23:54.999494 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8479a7e1-182a-46a8-8cb1-1ffe41ff0d94 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 404 len: 111 microversion: 2.1 time: 0.030314 Aug 26 06:23:54.999494 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 491/971] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:54 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 06:23:55.003869 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bb447aa3-d110-4a30-9f75-55527afafc35 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '.version_select at 0x7f2f08fa69d0>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:55.061785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ccfe9359-051e-4c8e-a79a-c351aae79a0d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:55.061785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ccfe9359-051e-4c8e-a79a-c351aae79a0d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.168572 Aug 26 06:23:55.061785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 481/972] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:54 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:55.413279 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bb447aa3-d110-4a30-9f75-55527afafc35 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-417126570" status: 202 len: 0 microversion: 2.1 time: 0.413080 Aug 26 06:23:55.413864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 492/973] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 26 06:23:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-417126570 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:23:55.818185 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-004545db-31c6-428d-b738-e462b61ff445 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:55.819183 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-004545db-31c6-428d-b738-e462b61ff445 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:55.825977 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-004545db-31c6-428d-b738-e462b61ff445 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:55.826710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-004545db-31c6-428d-b738-e462b61ff445 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:55.827355 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-004545db-31c6-428d-b738-e462b61ff445 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:55.828153 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-004545db-31c6-428d-b738-e462b61ff445 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:55.829892 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-004545db-31c6-428d-b738-e462b61ff445 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:55.830564 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-004545db-31c6-428d-b738-e462b61ff445 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:55.993442 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-004545db-31c6-428d-b738-e462b61ff445 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:56.001739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-004545db-31c6-428d-b738-e462b61ff445 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1259 microversion: 2.1 time: 0.189362 Aug 26 06:23:56.002321 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 482/974] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:55 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:23:56.082377 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-fa436372-6096-417e-bb57-9d2085a6e3a7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:56.083274 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-fa436372-6096-417e-bb57-9d2085a6e3a7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:56.090520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fa436372-6096-417e-bb57-9d2085a6e3a7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:56.091493 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fa436372-6096-417e-bb57-9d2085a6e3a7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:56.092090 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fa436372-6096-417e-bb57-9d2085a6e3a7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:56.093246 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fa436372-6096-417e-bb57-9d2085a6e3a7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:56.094711 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fa436372-6096-417e-bb57-9d2085a6e3a7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:56.096204 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fa436372-6096-417e-bb57-9d2085a6e3a7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:56.100917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:23:56.331572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fa436372-6096-417e-bb57-9d2085a6e3a7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:56.340416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-fa436372-6096-417e-bb57-9d2085a6e3a7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.264044 Aug 26 06:23:56.341074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 493/975] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:56 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:57.023800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fbdf54ce-d4f5-4ada-b5b9-947362d83498 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:57.024473 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fbdf54ce-d4f5-4ada-b5b9-947362d83498 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:57.034446 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fbdf54ce-d4f5-4ada-b5b9-947362d83498 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:57.035094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fbdf54ce-d4f5-4ada-b5b9-947362d83498 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:57.039904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fbdf54ce-d4f5-4ada-b5b9-947362d83498 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:57.039904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fbdf54ce-d4f5-4ada-b5b9-947362d83498 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:57.039904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fbdf54ce-d4f5-4ada-b5b9-947362d83498 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:57.039904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fbdf54ce-d4f5-4ada-b5b9-947362d83498 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:57.193157 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fbdf54ce-d4f5-4ada-b5b9-947362d83498 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:57.212145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fbdf54ce-d4f5-4ada-b5b9-947362d83498 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1259 microversion: 2.1 time: 0.181361 Aug 26 06:23:57.212145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 483/976] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:57 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:57.362323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0873f9f8-43f2-4570-9912-e88876a597f4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:57.362886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0873f9f8-43f2-4570-9912-e88876a597f4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:57.369339 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0873f9f8-43f2-4570-9912-e88876a597f4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:57.369837 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0873f9f8-43f2-4570-9912-e88876a597f4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:57.370277 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0873f9f8-43f2-4570-9912-e88876a597f4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:57.370994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0873f9f8-43f2-4570-9912-e88876a597f4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:57.371436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0873f9f8-43f2-4570-9912-e88876a597f4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:57.371869 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0873f9f8-43f2-4570-9912-e88876a597f4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:57.504124 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0873f9f8-43f2-4570-9912-e88876a597f4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:57.511882 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0873f9f8-43f2-4570-9912-e88876a597f4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.154768 Aug 26 06:23:57.512439 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 494/977] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:57 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:58.226748 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b2481aa8-9337-452c-8364-6421523a7718 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:58.227350 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b2481aa8-9337-452c-8364-6421523a7718 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:58.233704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2481aa8-9337-452c-8364-6421523a7718 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:58.234187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2481aa8-9337-452c-8364-6421523a7718 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:58.234691 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2481aa8-9337-452c-8364-6421523a7718 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:58.235391 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2481aa8-9337-452c-8364-6421523a7718 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:58.235845 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2481aa8-9337-452c-8364-6421523a7718 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:58.236291 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2481aa8-9337-452c-8364-6421523a7718 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:58.376632 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b2481aa8-9337-452c-8364-6421523a7718 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:58.384631 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b2481aa8-9337-452c-8364-6421523a7718 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1259 microversion: 2.1 time: 0.162635 Aug 26 06:23:58.385193 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 484/978] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:58 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:58.533328 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-540e8c98-6065-40ea-81b1-c06e2feaab12 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:58.533925 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-540e8c98-6065-40ea-81b1-c06e2feaab12 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:58.541210 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-540e8c98-6065-40ea-81b1-c06e2feaab12 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:58.541742 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-540e8c98-6065-40ea-81b1-c06e2feaab12 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:58.542119 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-540e8c98-6065-40ea-81b1-c06e2feaab12 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:58.542842 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-540e8c98-6065-40ea-81b1-c06e2feaab12 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:58.543292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-540e8c98-6065-40ea-81b1-c06e2feaab12 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:58.543710 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-540e8c98-6065-40ea-81b1-c06e2feaab12 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:58.683576 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-540e8c98-6065-40ea-81b1-c06e2feaab12 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:58.691592 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-540e8c98-6065-40ea-81b1-c06e2feaab12 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.163115 Aug 26 06:23:58.692222 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 495/979] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:58 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:59.404368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f7675a84-3c72-4ca8-9d7b-b4260d568717 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:59.404976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f7675a84-3c72-4ca8-9d7b-b4260d568717 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:59.412235 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7675a84-3c72-4ca8-9d7b-b4260d568717 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:59.412655 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7675a84-3c72-4ca8-9d7b-b4260d568717 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:59.413096 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7675a84-3c72-4ca8-9d7b-b4260d568717 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:59.413787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7675a84-3c72-4ca8-9d7b-b4260d568717 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:59.414244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7675a84-3c72-4ca8-9d7b-b4260d568717 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:59.414700 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f7675a84-3c72-4ca8-9d7b-b4260d568717 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:59.559203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f7675a84-3c72-4ca8-9d7b-b4260d568717 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:59.568680 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f7675a84-3c72-4ca8-9d7b-b4260d568717 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1259 microversion: 2.1 time: 0.168069 Aug 26 06:23:59.569316 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 485/980] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:59 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:23:59.713191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-2e7643f6-788d-44ca-910c-2f50f12a1dc9 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:23:59.713714 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-2e7643f6-788d-44ca-910c-2f50f12a1dc9 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:23:59.721453 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2e7643f6-788d-44ca-910c-2f50f12a1dc9 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:59.721932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2e7643f6-788d-44ca-910c-2f50f12a1dc9 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:59.722364 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2e7643f6-788d-44ca-910c-2f50f12a1dc9 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:59.723084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2e7643f6-788d-44ca-910c-2f50f12a1dc9 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:23:59.723533 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2e7643f6-788d-44ca-910c-2f50f12a1dc9 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:23:59.723956 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-2e7643f6-788d-44ca-910c-2f50f12a1dc9 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:23:59.873497 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-2e7643f6-788d-44ca-910c-2f50f12a1dc9 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:23:59.878692 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-2e7643f6-788d-44ca-910c-2f50f12a1dc9 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.169418 Aug 26 06:23:59.879273 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 496/981] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:23:59 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:00.590788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-58bc2326-4b12-4e81-bc5a-8fefbbac07e5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:00.591417 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-58bc2326-4b12-4e81-bc5a-8fefbbac07e5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:00.598062 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-58bc2326-4b12-4e81-bc5a-8fefbbac07e5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:00.598545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-58bc2326-4b12-4e81-bc5a-8fefbbac07e5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:00.599058 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-58bc2326-4b12-4e81-bc5a-8fefbbac07e5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:00.599753 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-58bc2326-4b12-4e81-bc5a-8fefbbac07e5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:00.600203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-58bc2326-4b12-4e81-bc5a-8fefbbac07e5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:00.600625 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-58bc2326-4b12-4e81-bc5a-8fefbbac07e5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:00.742293 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-58bc2326-4b12-4e81-bc5a-8fefbbac07e5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:00.750997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-58bc2326-4b12-4e81-bc5a-8fefbbac07e5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1259 microversion: 2.1 time: 0.163714 Aug 26 06:24:00.751558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 486/982] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:00 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:00.900143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7a2afbba-51fd-4501-90b9-c7886e542739 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:00.900866 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7a2afbba-51fd-4501-90b9-c7886e542739 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:00.907565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a2afbba-51fd-4501-90b9-c7886e542739 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:00.908054 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a2afbba-51fd-4501-90b9-c7886e542739 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:00.908497 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a2afbba-51fd-4501-90b9-c7886e542739 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:00.909199 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a2afbba-51fd-4501-90b9-c7886e542739 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:00.909655 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a2afbba-51fd-4501-90b9-c7886e542739 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:00.910084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a2afbba-51fd-4501-90b9-c7886e542739 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:01.044051 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7a2afbba-51fd-4501-90b9-c7886e542739 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:01.052962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7a2afbba-51fd-4501-90b9-c7886e542739 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.156624 Aug 26 06:24:01.053527 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 497/983] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:00 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:01.312264 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-ef671405-93c2-46ac-9542-def93692ab58 req-491affdf-8c6d-4ee0-9766-ccac025c6329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4228acc2-99a7-47c3-9cef-92c0f7bcb7b0", "name": "network-vif-plugged", "status": "completed", "tag": "16e251e3-f929-404a-95a5-e7b555e4782f"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:24:01.332912 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-ef671405-93c2-46ac-9542-def93692ab58 req-491affdf-8c6d-4ee0-9766-ccac025c6329 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:01.333534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-ef671405-93c2-46ac-9542-def93692ab58 req-491affdf-8c6d-4ee0-9766-ccac025c6329 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:01.334157 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-ef671405-93c2-46ac-9542-def93692ab58 req-491affdf-8c6d-4ee0-9766-ccac025c6329 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:01.350282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-ef671405-93c2-46ac-9542-def93692ab58 req-491affdf-8c6d-4ee0-9766-ccac025c6329 service nova] Creating event network-vif-plugged:16e251e3-f929-404a-95a5-e7b555e4782f for instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 on hv-cinder-85391 Aug 26 06:24:01.355833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-ef671405-93c2-46ac-9542-def93692ab58 req-491affdf-8c6d-4ee0-9766-ccac025c6329 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047816 Aug 26 06:24:01.356482 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 487/984] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:24:01.580095 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:01.600901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:01.600901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:01.600901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:01.600901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:01.601510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:01.601510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:01.601510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:01.604243 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] HTTP exception thrown: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Request method failure captured: Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: DELETE /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d HTTP/1.1 Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGVEi2sDXAvdvv0HOjOhYG6O-5VK8zNRXflkr7zgg20kn-Pl3aXACI09HI_Bzo_JAoPt_SKluW9p9eIX44jqqougK0jcKZduIAPehwvlKYPagzLHHrZ77XFhCi8EgJB16YzWV-h6lpMKhj3GrHQboIpM60heVYH7Z-nR8p0FfSXnXfs Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:24:01.605784 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aceecfa04cf941348d542c3e55569384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aceecfa04cf941348d542c3e55569384"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 1d22ea3fb8fa4bd99537fb83279b2d24 Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:24:01.607522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': '718e8607-e647-40b3-aa7d-16d5f5cd577d'} Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:24:01.608760 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:24:01.611160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:24:01.612664 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Returning 404 to user: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:24:01.612664 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-604dcfaa-8856-45e5-a423-744174d66133 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "DELETE /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 404 len: 111 microversion: 2.1 time: 0.032379 Aug 26 06:24:01.612664 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 498/985] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:24:01 2022] DELETE /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:24:01.617127 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:01.617821 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: 718e8607-e647-40b3-aa7d-16d5f5cd577d] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:01.625154 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:01.625719 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:01.626292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:01.627009 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:01.627501 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:01.627958 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:01.644399 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] HTTP exception thrown: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Request method failure captured: Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d HTTP/1.1 Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGVEi2sDXAvdvv0HOjOhYG6O-5VK8zNRXflkr7zgg20kn-Pl3aXACI09HI_Bzo_JAoPt_SKluW9p9eIX44jqqougK0jcKZduIAPehwvlKYPagzLHHrZ77XFhCi8EgJB16YzWV-h6lpMKhj3GrHQboIpM60heVYH7Z-nR8p0FfSXnXfs Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:24:01.646078 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aceecfa04cf941348d542c3e55569384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aceecfa04cf941348d542c3e55569384"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 1d22ea3fb8fa4bd99537fb83279b2d24 Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:24:01.647654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '718e8607-e647-40b3-aa7d-16d5f5cd577d'} Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:24:01.648492 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. Aug 26 06:24:01.649742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:01.651925 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Returning 404 to user: Instance 718e8607-e647-40b3-aa7d-16d5f5cd577d could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:24:01.652779 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-53d264c7-c026-439c-8690-5ed7b4ef6f41 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d" status: 404 len: 111 microversion: 2.1 time: 0.040455 Aug 26 06:24:01.653590 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 488/986] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:01 2022] GET /compute/v2.1/servers/718e8607-e647-40b3-aa7d-16d5f5cd577d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:24:01.772825 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4661ec41-992b-48e9-8750-abed9f7ab7f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:01.773349 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4661ec41-992b-48e9-8750-abed9f7ab7f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:01.779469 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4661ec41-992b-48e9-8750-abed9f7ab7f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:01.782319 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4661ec41-992b-48e9-8750-abed9f7ab7f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:01.782319 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4661ec41-992b-48e9-8750-abed9f7ab7f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:01.787634 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4661ec41-992b-48e9-8750-abed9f7ab7f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:01.792547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4661ec41-992b-48e9-8750-abed9f7ab7f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:01.793113 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4661ec41-992b-48e9-8750-abed9f7ab7f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:02.009160 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4661ec41-992b-48e9-8750-abed9f7ab7f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:02.018609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4661ec41-992b-48e9-8750-abed9f7ab7f2 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1259 microversion: 2.1 time: 0.249595 Aug 26 06:24:02.018908 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 499/987] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:01 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:02.074792 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b2f36d40-f5ae-48eb-9352-ce9bd1e990eb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:02.085787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b2f36d40-f5ae-48eb-9352-ce9bd1e990eb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:02.085787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f36d40-f5ae-48eb-9352-ce9bd1e990eb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:02.085787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f36d40-f5ae-48eb-9352-ce9bd1e990eb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:02.085787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f36d40-f5ae-48eb-9352-ce9bd1e990eb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:02.086292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f36d40-f5ae-48eb-9352-ce9bd1e990eb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:02.086292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f36d40-f5ae-48eb-9352-ce9bd1e990eb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:02.086292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b2f36d40-f5ae-48eb-9352-ce9bd1e990eb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:02.222218 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b2f36d40-f5ae-48eb-9352-ce9bd1e990eb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:02.230430 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b2f36d40-f5ae-48eb-9352-ce9bd1e990eb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.159523 Aug 26 06:24:02.231027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 489/988] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:02 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:03.039815 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-234d11b7-7c71-4530-9ff3-6d3065b67d6f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:03.040459 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-234d11b7-7c71-4530-9ff3-6d3065b67d6f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:03.048787 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-234d11b7-7c71-4530-9ff3-6d3065b67d6f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:03.049310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-234d11b7-7c71-4530-9ff3-6d3065b67d6f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:03.049745 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-234d11b7-7c71-4530-9ff3-6d3065b67d6f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:03.050730 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-234d11b7-7c71-4530-9ff3-6d3065b67d6f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:03.051179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-234d11b7-7c71-4530-9ff3-6d3065b67d6f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:03.051598 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-234d11b7-7c71-4530-9ff3-6d3065b67d6f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:03.089252 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:03.089787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:03.099785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:03.100284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:03.100915 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:03.101794 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:03.102425 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:03.103114 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:03.118327 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] HTTP exception thrown: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Request method failure captured: Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: DELETE /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 HTTP/1.1 Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGVEi2sDXAvdvv0HOjOhYG6O-5VK8zNRXflkr7zgg20kn-Pl3aXACI09HI_Bzo_JAoPt_SKluW9p9eIX44jqqougK0jcKZduIAPehwvlKYPagzLHHrZ77XFhCi8EgJB16YzWV-h6lpMKhj3GrHQboIpM60heVYH7Z-nR8p0FfSXnXfs Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:24:03.119956 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aceecfa04cf941348d542c3e55569384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aceecfa04cf941348d542c3e55569384"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 1d22ea3fb8fa4bd99537fb83279b2d24 Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:24:03.121543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'c0dda9da-e7bd-4a7d-b807-a2074ccbe208'} Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:24:03.122396 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:24:03.123849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:03.126196 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Returning 404 to user: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:24:03.127113 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f79e54a2-c956-46cf-a97b-0159c4aea118 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 404 len: 111 microversion: 2.1 time: 0.049263 Aug 26 06:24:03.127682 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 490/989] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:24:03 2022] DELETE /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 06:24:03.135393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:03.136012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] [instance: c0dda9da-e7bd-4a7d-b807-a2074ccbe208] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:03.142730 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:03.143259 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:03.143655 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:03.144441 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:03.144900 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:03.145327 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:03.160722 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] HTTP exception thrown: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Request method failure captured: Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 HTTP/1.1 Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGVEi2sDXAvdvv0HOjOhYG6O-5VK8zNRXflkr7zgg20kn-Pl3aXACI09HI_Bzo_JAoPt_SKluW9p9eIX44jqqougK0jcKZduIAPehwvlKYPagzLHHrZ77XFhCi8EgJB16YzWV-h6lpMKhj3GrHQboIpM60heVYH7Z-nR8p0FfSXnXfs Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:24:03.162296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/aceecfa04cf941348d542c3e55569384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/aceecfa04cf941348d542c3e55569384"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_aceecfa04cf941348d542c3e55569384"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: aceecfa04cf941348d542c3e55569384 Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932453734 Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 1d22ea3fb8fa4bd99537fb83279b2d24 Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeTestJSON-932453734-project Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:24:03.163802 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'c0dda9da-e7bd-4a7d-b807-a2074ccbe208'} Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:24:03.164535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. Aug 26 06:24:03.166150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:24:03.167270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] Returning 404 to user: Instance c0dda9da-e7bd-4a7d-b807-a2074ccbe208 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:24:03.167270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-44f641bc-aa54-48bb-8574-f01251852096 tempest-AttachVolumeTestJSON-932453734 tempest-AttachVolumeTestJSON-932453734-project] 10.222.0.40 "GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208" status: 404 len: 111 microversion: 2.1 time: 0.032114 Aug 26 06:24:03.167270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 491/990] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:03 2022] GET /compute/v2.1/servers/c0dda9da-e7bd-4a7d-b807-a2074ccbe208 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 06:24:03.201547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-234d11b7-7c71-4530-9ff3-6d3065b67d6f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:03.207723 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-234d11b7-7c71-4530-9ff3-6d3065b67d6f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1259 microversion: 2.1 time: 0.172167 Aug 26 06:24:03.208293 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 500/991] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:03 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:03.252316 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ec7b3750-459a-49d2-a015-cbb76fc7727c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:03.252849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ec7b3750-459a-49d2-a015-cbb76fc7727c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:03.259032 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ec7b3750-459a-49d2-a015-cbb76fc7727c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:03.259643 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ec7b3750-459a-49d2-a015-cbb76fc7727c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:03.260083 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ec7b3750-459a-49d2-a015-cbb76fc7727c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:03.260775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ec7b3750-459a-49d2-a015-cbb76fc7727c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:03.261230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ec7b3750-459a-49d2-a015-cbb76fc7727c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:03.261684 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ec7b3750-459a-49d2-a015-cbb76fc7727c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:03.371126 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-72ce3a60-b8ad-48ef-8df0-6901225ce51a req-af80f0ab-2253-4e25-846c-7384205095a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4ec4be-d09b-431b-93f0-062334195c69", "name": "network-vif-plugged", "status": "completed", "tag": "07d50961-0e64-446f-a7b3-9104f5a9a451"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:24:03.380587 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-72ce3a60-b8ad-48ef-8df0-6901225ce51a req-af80f0ab-2253-4e25-846c-7384205095a9 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:03.381066 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-72ce3a60-b8ad-48ef-8df0-6901225ce51a req-af80f0ab-2253-4e25-846c-7384205095a9 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:03.381493 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-72ce3a60-b8ad-48ef-8df0-6901225ce51a req-af80f0ab-2253-4e25-846c-7384205095a9 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:03.393360 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-72ce3a60-b8ad-48ef-8df0-6901225ce51a req-af80f0ab-2253-4e25-846c-7384205095a9 service nova] Creating event network-vif-plugged:07d50961-0e64-446f-a7b3-9104f5a9a451 for instance ce4ec4be-d09b-431b-93f0-062334195c69 on hv-cinder-85391 Aug 26 06:24:03.398344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-72ce3a60-b8ad-48ef-8df0-6901225ce51a req-af80f0ab-2253-4e25-846c-7384205095a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030833 Aug 26 06:24:03.398977 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 501/992] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:24:03.483630 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ec7b3750-459a-49d2-a015-cbb76fc7727c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:03.491785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ec7b3750-459a-49d2-a015-cbb76fc7727c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.243555 Aug 26 06:24:03.492347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 492/993] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:03 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:04.229822 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a293fddc-c1da-4866-9ea2-9469ba1bb845 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:04.230517 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a293fddc-c1da-4866-9ea2-9469ba1bb845 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:04.237914 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a293fddc-c1da-4866-9ea2-9469ba1bb845 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:04.238455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a293fddc-c1da-4866-9ea2-9469ba1bb845 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:04.238925 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a293fddc-c1da-4866-9ea2-9469ba1bb845 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:04.239651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a293fddc-c1da-4866-9ea2-9469ba1bb845 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:04.240109 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a293fddc-c1da-4866-9ea2-9469ba1bb845 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:04.240534 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a293fddc-c1da-4866-9ea2-9469ba1bb845 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:04.380375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a293fddc-c1da-4866-9ea2-9469ba1bb845 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:04.393651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a293fddc-c1da-4866-9ea2-9469ba1bb845 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1443 microversion: 2.1 time: 0.168566 Aug 26 06:24:04.394238 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 502/994] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:04 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:04.415983 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c8ecc8a0-9926-4873-b76a-c037387133f9 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:04.417359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c8ecc8a0-9926-4873-b76a-c037387133f9 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:04.425379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8ecc8a0-9926-4873-b76a-c037387133f9 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:04.425877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8ecc8a0-9926-4873-b76a-c037387133f9 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:04.426321 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8ecc8a0-9926-4873-b76a-c037387133f9 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:04.427111 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8ecc8a0-9926-4873-b76a-c037387133f9 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:04.427586 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8ecc8a0-9926-4873-b76a-c037387133f9 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:04.428013 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c8ecc8a0-9926-4873-b76a-c037387133f9 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:04.512953 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-22ebbaea-2145-4361-ad75-ce654518f3d3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:04.513666 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-22ebbaea-2145-4361-ad75-ce654518f3d3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:04.521062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ebbaea-2145-4361-ad75-ce654518f3d3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:04.522505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ebbaea-2145-4361-ad75-ce654518f3d3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:04.523362 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ebbaea-2145-4361-ad75-ce654518f3d3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:04.524468 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ebbaea-2145-4361-ad75-ce654518f3d3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:04.525282 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ebbaea-2145-4361-ad75-ce654518f3d3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:04.525841 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-22ebbaea-2145-4361-ad75-ce654518f3d3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:04.660558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c8ecc8a0-9926-4873-b76a-c037387133f9 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:04.668968 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c8ecc8a0-9926-4873-b76a-c037387133f9 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1443 microversion: 2.1 time: 0.256850 Aug 26 06:24:04.669883 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 493/995] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:04 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1443 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:04.698995 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-22ebbaea-2145-4361-ad75-ce654518f3d3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:04.709644 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-22ebbaea-2145-4361-ad75-ce654518f3d3 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.199842 Aug 26 06:24:04.710478 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 503/996] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:04 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:05.735405 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-99bec12f-7323-4cc8-929d-fbdc02e82e6a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:05.736285 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-99bec12f-7323-4cc8-929d-fbdc02e82e6a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:05.743253 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99bec12f-7323-4cc8-929d-fbdc02e82e6a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:05.743751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99bec12f-7323-4cc8-929d-fbdc02e82e6a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:05.744186 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99bec12f-7323-4cc8-929d-fbdc02e82e6a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:05.744927 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99bec12f-7323-4cc8-929d-fbdc02e82e6a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:05.745382 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99bec12f-7323-4cc8-929d-fbdc02e82e6a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:05.745931 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99bec12f-7323-4cc8-929d-fbdc02e82e6a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:05.800471 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e4ab1161-fe35-473c-b5cc-ab59a6aa44a2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:05.801344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e4ab1161-fe35-473c-b5cc-ab59a6aa44a2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:05.808047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4ab1161-fe35-473c-b5cc-ab59a6aa44a2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:05.808805 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4ab1161-fe35-473c-b5cc-ab59a6aa44a2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:05.809758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4ab1161-fe35-473c-b5cc-ab59a6aa44a2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:05.810412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4ab1161-fe35-473c-b5cc-ab59a6aa44a2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:05.810900 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4ab1161-fe35-473c-b5cc-ab59a6aa44a2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:05.811324 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e4ab1161-fe35-473c-b5cc-ab59a6aa44a2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:05.840437 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e4ab1161-fe35-473c-b5cc-ab59a6aa44a2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/ips" status: 200 len: 151 microversion: 2.20 time: 0.044605 Aug 26 06:24:05.843433 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 504/997] 10.222.0.40 () {60 vars in 1289 bytes} [Fri Aug 26 06:24:05 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 06:24:05.923783 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-99bec12f-7323-4cc8-929d-fbdc02e82e6a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:05.940899 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-99bec12f-7323-4cc8-929d-fbdc02e82e6a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.205254 Aug 26 06:24:05.940899 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 494/998] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:05 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:06.959463 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-670bdbb2-740b-4e75-9ecf-ac9b99be81c6 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:06.960011 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-670bdbb2-740b-4e75-9ecf-ac9b99be81c6 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:06.966578 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-670bdbb2-740b-4e75-9ecf-ac9b99be81c6 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:06.967047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-670bdbb2-740b-4e75-9ecf-ac9b99be81c6 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:06.967486 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-670bdbb2-740b-4e75-9ecf-ac9b99be81c6 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:06.968182 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-670bdbb2-740b-4e75-9ecf-ac9b99be81c6 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:06.968679 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-670bdbb2-740b-4e75-9ecf-ac9b99be81c6 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:06.969943 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-670bdbb2-740b-4e75-9ecf-ac9b99be81c6 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:07.329806 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-670bdbb2-740b-4e75-9ecf-ac9b99be81c6 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:07.338407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-670bdbb2-740b-4e75-9ecf-ac9b99be81c6 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.382802 Aug 26 06:24:07.342233 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 505/999] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:06 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:08.022465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-cc0d592c-2935-408e-af96-c4beaa07a81e req-3499a897-34bf-448c-bb48-53b2f143f9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4228acc2-99a7-47c3-9cef-92c0f7bcb7b0", "tag": "16e251e3-f929-404a-95a5-e7b555e4782f"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:24:08.034512 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-cc0d592c-2935-408e-af96-c4beaa07a81e req-3499a897-34bf-448c-bb48-53b2f143f9c2 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:08.035033 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-cc0d592c-2935-408e-af96-c4beaa07a81e req-3499a897-34bf-448c-bb48-53b2f143f9c2 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:08.036929 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-cc0d592c-2935-408e-af96-c4beaa07a81e req-3499a897-34bf-448c-bb48-53b2f143f9c2 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:08.047590 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-cc0d592c-2935-408e-af96-c4beaa07a81e req-3499a897-34bf-448c-bb48-53b2f143f9c2 service nova] Creating event network-changed:16e251e3-f929-404a-95a5-e7b555e4782f for instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 on hv-cinder-85391 Aug 26 06:24:08.054720 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-cc0d592c-2935-408e-af96-c4beaa07a81e req-3499a897-34bf-448c-bb48-53b2f143f9c2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036455 Aug 26 06:24:08.055354 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 495/1000] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:24:08.367474 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b1a17ff9-2690-4ab5-8911-f809242c838f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:08.369196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b1a17ff9-2690-4ab5-8911-f809242c838f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:08.377441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1a17ff9-2690-4ab5-8911-f809242c838f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:08.378023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1a17ff9-2690-4ab5-8911-f809242c838f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:08.378659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1a17ff9-2690-4ab5-8911-f809242c838f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:08.379537 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1a17ff9-2690-4ab5-8911-f809242c838f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:08.379997 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1a17ff9-2690-4ab5-8911-f809242c838f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:08.380419 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1a17ff9-2690-4ab5-8911-f809242c838f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:08.612941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b1a17ff9-2690-4ab5-8911-f809242c838f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:08.621176 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b1a17ff9-2690-4ab5-8911-f809242c838f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1267 microversion: 2.1 time: 0.259315 Aug 26 06:24:08.621970 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 506/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:08 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:09.644388 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6a8bb68b-6dd8-4fef-ba5b-3e0bd0942cae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:09.644997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6a8bb68b-6dd8-4fef-ba5b-3e0bd0942cae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:09.651202 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a8bb68b-6dd8-4fef-ba5b-3e0bd0942cae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:09.651680 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a8bb68b-6dd8-4fef-ba5b-3e0bd0942cae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:09.652112 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a8bb68b-6dd8-4fef-ba5b-3e0bd0942cae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:09.652796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a8bb68b-6dd8-4fef-ba5b-3e0bd0942cae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:09.653247 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a8bb68b-6dd8-4fef-ba5b-3e0bd0942cae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:09.653667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a8bb68b-6dd8-4fef-ba5b-3e0bd0942cae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:09.789576 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6a8bb68b-6dd8-4fef-ba5b-3e0bd0942cae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:09.797763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6a8bb68b-6dd8-4fef-ba5b-3e0bd0942cae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1454 microversion: 2.1 time: 0.159062 Aug 26 06:24:09.798319 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 496/1002] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:09 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:09.818682 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f2cde090-04b9-4cc6-a961-17383f65f86c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:09.819295 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f2cde090-04b9-4cc6-a961-17383f65f86c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:09.826161 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f2cde090-04b9-4cc6-a961-17383f65f86c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:09.826361 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f2cde090-04b9-4cc6-a961-17383f65f86c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:09.826673 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f2cde090-04b9-4cc6-a961-17383f65f86c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:09.827433 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f2cde090-04b9-4cc6-a961-17383f65f86c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:09.827892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f2cde090-04b9-4cc6-a961-17383f65f86c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:09.829134 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f2cde090-04b9-4cc6-a961-17383f65f86c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:09.960946 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f2cde090-04b9-4cc6-a961-17383f65f86c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:09.968568 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f2cde090-04b9-4cc6-a961-17383f65f86c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1454 microversion: 2.1 time: 0.153757 Aug 26 06:24:09.969166 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 507/1003] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:24:09 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:24:10.093137 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f98b0039-65f8-466f-a4d7-37e25d3440f1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:24:10.093759 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f98b0039-65f8-466f-a4d7-37e25d3440f1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:10.100393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98b0039-65f8-466f-a4d7-37e25d3440f1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:10.105170 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98b0039-65f8-466f-a4d7-37e25d3440f1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:10.106538 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98b0039-65f8-466f-a4d7-37e25d3440f1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:10.133864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98b0039-65f8-466f-a4d7-37e25d3440f1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:10.133864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98b0039-65f8-466f-a4d7-37e25d3440f1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:10.133864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98b0039-65f8-466f-a4d7-37e25d3440f1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:10.135262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-f98b0039-65f8-466f-a4d7-37e25d3440f1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lazy-loading 'flavor' on Instance uuid ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:24:10.161994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:24:11.003751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f98b0039-65f8-466f-a4d7-37e25d3440f1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "POST /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/action" status: 202 len: 0 microversion: 2.20 time: 0.914006 Aug 26 06:24:11.005089 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 497/1004] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 26 06:24:10 2022] POST /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/action => generated 0 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:24:11.017363 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:11.019619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:11.025764 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:11.026753 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:11.027434 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:11.028180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:11.029491 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:11.029491 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:11.193723 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:11.202767 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:11.204408 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:11.206273 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cb4d2805-a037-4d1c-b40d-92cdcbd11476 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.196322 Aug 26 06:24:11.206953 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 508/1005] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:11 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:12.232992 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:12.233694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:12.242020 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:12.243671 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:12.243671 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:12.243888 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:12.244228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:12.244666 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:12.396473 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:12.407637 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:12.409127 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:12.411353 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-aa02658e-4b87-49f7-b17f-db704e5ad5c0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.182668 Aug 26 06:24:12.411353 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 498/1006] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:12 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:12.483935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-1680e4f9-2c69-4536-a0ff-e977f37b4ba7 req-2140ba1f-6df9-4857-acd8-a09c50a84282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce4ec4be-d09b-431b-93f0-062334195c69", "tag": "07d50961-0e64-446f-a7b3-9104f5a9a451"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:24:12.494424 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1680e4f9-2c69-4536-a0ff-e977f37b4ba7 req-2140ba1f-6df9-4857-acd8-a09c50a84282 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:12.495114 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1680e4f9-2c69-4536-a0ff-e977f37b4ba7 req-2140ba1f-6df9-4857-acd8-a09c50a84282 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:12.495573 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1680e4f9-2c69-4536-a0ff-e977f37b4ba7 req-2140ba1f-6df9-4857-acd8-a09c50a84282 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:12.508202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-1680e4f9-2c69-4536-a0ff-e977f37b4ba7 req-2140ba1f-6df9-4857-acd8-a09c50a84282 service nova] Creating event network-changed:07d50961-0e64-446f-a7b3-9104f5a9a451 for instance ce4ec4be-d09b-431b-93f0-062334195c69 on hv-cinder-85391 Aug 26 06:24:12.513520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-1680e4f9-2c69-4536-a0ff-e977f37b4ba7 req-2140ba1f-6df9-4857-acd8-a09c50a84282 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033284 Aug 26 06:24:12.522323 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 509/1007] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:24:13.436472 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:13.437232 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:13.445190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:13.445686 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:13.446131 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:13.446980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:13.447443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:13.447868 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:13.602641 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:13.613771 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:13.615305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:13.616534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fba016b5-7da7-4fc6-b97f-52653c5f417b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.184727 Aug 26 06:24:13.617343 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 499/1008] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:13 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:24:14.641481 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:14.642435 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:14.649304 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:14.649773 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:14.650201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:14.651004 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:14.651449 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:14.652011 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:14.794043 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:14.803489 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:14.804852 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:14.806035 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e7497bc0-dec5-4dc2-9f8a-d4f436ea577c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.169358 Aug 26 06:24:14.806576 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 510/1009] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:14 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:15.829014 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:15.829627 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:15.836577 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:15.837065 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:15.837503 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:15.838205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:15.838716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:15.839139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:15.972340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:15.980506 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:15.982082 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:15.983255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a32ef49f-0fc7-4fd3-8f83-1f7c5c9c0f70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.158937 Aug 26 06:24:15.983812 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 500/1010] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:15 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:24:17.007628 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:17.129428 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:17.129428 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:17.129428 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:17.129428 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:17.131184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:17.131184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:17.131184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:17.158267 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:17.166451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:17.167921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:17.169069 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-33a4683f-dc27-4260-ad8c-38313cab3ac1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.165922 Aug 26 06:24:17.169621 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 511/1011] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:17 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:18.193042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:18.193652 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:18.200089 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:18.203440 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:18.203440 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:18.203440 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:18.203440 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:18.204057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:18.337676 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:18.346657 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:18.354457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:18.354457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f9a83436-23d9-47e5-a17a-c169c9aecba8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.160195 Aug 26 06:24:18.354457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 501/1012] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:18 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:24:19.373002 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:19.373543 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:19.381030 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:19.381523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:19.381958 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:19.382671 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:19.383241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:19.383667 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:19.387946 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=100 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:24:19.519653 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:19.527649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:19.529102 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:19.530672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f13a81df-dab9-4f30-bb8c-f61b9fe8adda tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.161641 Aug 26 06:24:19.531983 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 512/1013] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:19 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:20.555336 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:20.556209 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:20.564480 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:20.571447 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:20.571447 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:20.571447 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:20.571447 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:20.572949 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:20.717154 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:20.725929 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:20.727457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:20.728620 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a61d09df-714a-4c4a-920d-4a57236bb8dd tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.177474 Aug 26 06:24:20.729171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 502/1014] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:20 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:21.753155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:21.753761 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:21.761295 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:21.763758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:21.763758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:21.763758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:21.763758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:21.764199 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:21.927789 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:21.935961 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:21.937963 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:21.939289 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d7025933-2068-4392-b050-f05ec2a1fa16 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.190418 Aug 26 06:24:21.939752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 513/1015] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:21 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:22.962219 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:22.963428 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:22.970782 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:22.971274 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:22.971709 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:22.972409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:22.972860 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:22.973322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:23.112738 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:23.123448 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:23.123448 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:23.123673 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2eaa26bf-cd6f-4477-9f52-828e395c5661 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.165465 Aug 26 06:24:23.124179 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 503/1016] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:22 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:24.147560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:24.148252 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:24.154752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:24.155276 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:24.156710 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:24.157573 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:24.158032 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:24.158464 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:24.294641 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:24.303217 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:24.304686 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:24.305831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-1ceca4dc-c801-4463-b436-26a4bf35bcca tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.162236 Aug 26 06:24:24.306391 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 514/1017] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:24 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:25.329720 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:25.332047 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:25.338288 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=72 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:24:25.341844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:25.342332 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:25.342801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:25.344073 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:25.344539 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:25.344966 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:25.489472 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:25.500891 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:25.502507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:25.504379 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ab8c9d36-8735-40e8-b739-2503e27dd240 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.178758 Aug 26 06:24:25.504982 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 504/1018] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:25 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:26.528297 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:26.532358 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:26.532705 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:24:26.537595 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:26.538074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:26.538504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:26.539243 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:26.539695 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:26.540116 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:26.676543 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:26.684630 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:26.686060 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:26.687844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-704cc90c-ffb5-4e57-a972-3a84d359f8a5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.163030 Aug 26 06:24:26.688391 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 515/1019] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:26 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:24:27.711029 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:27.711590 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:27.719165 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:27.722864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:27.722864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:27.722864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:27.722864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:27.723227 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:27.872515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:27.881606 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:27.883280 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:27.884463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8f632bcd-1cfa-4467-b4cd-1c9e1f4a5334 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.177593 Aug 26 06:24:27.885015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 505/1020] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:27 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:28.908853 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:28.909660 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:28.916577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:28.917062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:28.917513 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:28.918191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:28.918671 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:28.919086 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:29.053023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:29.061307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:29.063625 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:29.064803 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-15b3f8f9-27d6-4cad-bb22-5a81d94717ce tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.160480 Aug 26 06:24:29.065363 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 516/1021] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:28 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:30.088911 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:30.089589 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:30.097390 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:30.097954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:30.098424 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:30.099321 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:30.099785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:30.100239 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:30.284443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:30.284443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:30.284772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:30.284772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-573b1f1c-5843-4f9c-9712-b28d6ba9228e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.188960 Aug 26 06:24:30.284772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 506/1022] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:30 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:31.306649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:31.309054 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:31.315335 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:31.315824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:31.316288 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:31.316987 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:31.317437 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:31.317861 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:31.467549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:31.476257 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:31.477853 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:31.479436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a84a4669-f867-4443-93b5-4d0c0e69b19a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.177072 Aug 26 06:24:31.479984 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 517/1023] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:31 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:32.503168 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:32.503732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:32.510236 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:32.510775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:32.511267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:32.511953 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:32.512405 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:32.512834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:32.649154 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:32.658072 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:32.659536 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:32.660812 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f1b170ca-d4b8-40bd-8294-7a34fb66db58 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.161913 Aug 26 06:24:32.661358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 507/1024] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:32 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:33.687973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:33.688578 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:33.695437 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:33.711412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:33.711412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:33.711412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:33.711412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:33.711939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:33.852552 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:33.863797 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:33.865296 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:33.866504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9b5da806-46f2-4061-ae44-891febb8643c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.185574 Aug 26 06:24:33.867086 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 518/1025] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:33 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:34.896980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:34.896980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:34.907240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:34.907240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:34.907240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:34.907240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:34.908155 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:34.908155 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:35.058043 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:35.068077 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:35.069975 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:35.071256 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-01c3ea14-9025-492c-9ad7-1985bf15f82c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1743 microversion: 2.20 time: 0.183110 Aug 26 06:24:35.072483 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 508/1026] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:34 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:24:36.098265 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:36.099038 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:36.105729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:36.106249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:36.106755 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:36.107399 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:36.107853 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:36.108312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:36.268494 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:36.277314 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:36.278796 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:36.280005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-40ee05fa-325e-4250-826e-f8264442c558 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1743 microversion: 2.20 time: 0.185704 Aug 26 06:24:36.281024 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 519/1027] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:36 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:36.849741 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-f44d3018-25ff-4ad8-a519-8f0a03190e82 req-77dc24d7-b0d7-44c8-9616-3b42d1f45dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1", "name": "network-vif-plugged", "status": "completed", "tag": "eae53896-6ef9-4506-ab00-a183cb7c9907"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:24:36.860443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f44d3018-25ff-4ad8-a519-8f0a03190e82 req-77dc24d7-b0d7-44c8-9616-3b42d1f45dae service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:36.866969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f44d3018-25ff-4ad8-a519-8f0a03190e82 req-77dc24d7-b0d7-44c8-9616-3b42d1f45dae service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:36.866969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f44d3018-25ff-4ad8-a519-8f0a03190e82 req-77dc24d7-b0d7-44c8-9616-3b42d1f45dae service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:36.873895 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-f44d3018-25ff-4ad8-a519-8f0a03190e82 req-77dc24d7-b0d7-44c8-9616-3b42d1f45dae service nova] Creating event network-vif-plugged:eae53896-6ef9-4506-ab00-a183cb7c9907 for instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 on hv-cinder-85391 Aug 26 06:24:36.879841 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-f44d3018-25ff-4ad8-a519-8f0a03190e82 req-77dc24d7-b0d7-44c8-9616-3b42d1f45dae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034099 Aug 26 06:24:36.880437 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 509/1028] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:24:37.304873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:37.305388 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:37.314151 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:37.314151 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:37.314151 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:37.315770 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:37.315770 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:37.316515 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:37.484101 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:37.493116 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:37.494571 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:37.495763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-17fe6d74-0293-400e-93d8-7cc1ff88b145 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.195457 Aug 26 06:24:37.496563 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 520/1029] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:37 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:38.522359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:38.523089 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:38.529466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:38.529953 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:38.530734 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:38.531597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:38.532065 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:38.532518 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:38.694985 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:38.706313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:38.707940 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:38.709188 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0207c3ce-5bd9-48c4-98f9-1094f4085a2f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.191842 Aug 26 06:24:38.709743 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 510/1030] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:38 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:39.734522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:39.737435 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:39.747640 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:39.748726 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:39.751165 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:39.753063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:39.754531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:39.757232 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:39.971047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:39.986977 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:39.990049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:39.992513 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-938769cd-39b3-4cf3-86e1-11017cdc96ba tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.262497 Aug 26 06:24:39.993580 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 521/1031] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:39 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:41.017867 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:41.018476 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:41.025075 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:41.025559 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:41.025998 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:41.026725 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:41.027181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:41.027722 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:41.169669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:41.179820 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:41.181254 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:41.182587 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3b9ecd14-dbb1-410d-bd1b-3fbd017ccd93 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.169198 Aug 26 06:24:41.183227 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 511/1032] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:41 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:42.211674 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:42.213036 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:42.220964 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:42.221451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:42.222103 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:42.222878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:42.223575 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:42.224007 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:42.373662 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:42.392511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:42.393968 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:42.395166 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7b643452-067a-4a7f-980e-d83cccb47268 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.187440 Aug 26 06:24:42.395729 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 522/1033] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:42 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:43.432806 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:43.434783 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:43.445705 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:43.446496 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:43.447140 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:43.448361 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:43.449357 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:43.450088 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:43.458542 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:24:43.762205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:43.773548 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:43.775340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:43.776581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9fee285b-cb64-4233-b506-86e1f95cdf88 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.356395 Aug 26 06:24:43.777374 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 512/1034] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:43 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:44.802467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:44.803112 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:44.809954 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:44.810441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:44.810927 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:44.811704 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:44.812416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:44.812600 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:44.976153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:44.984921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:45.005117 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:45.005117 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b46b3300-0218-4c5b-91d0-68638e9e4aed tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.191357 Aug 26 06:24:45.005117 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 523/1035] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:44 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:46.029780 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:46.031306 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:46.040355 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:46.041385 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:46.041984 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:46.043318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:46.044003 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:46.044702 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:46.213145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:46.225555 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:46.227368 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:46.229086 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-dcf6ddf7-9a6d-43bd-a956-ca6e64330e70 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.203554 Aug 26 06:24:46.232463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 513/1036] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:46 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:47.252683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:47.253367 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:47.260177 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:47.260751 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:47.261269 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:47.262043 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:47.262564 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:47.263210 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:47.458177 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:47.471886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:47.473984 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:47.475196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3fa874d2-03f7-4a55-9bbb-fe0ec3b72919 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.227263 Aug 26 06:24:47.490656 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 524/1037] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:47 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:48.499756 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:48.500361 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:48.507265 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:48.507755 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:48.508194 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:48.508881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:48.509334 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:48.509757 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:48.665229 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:48.674349 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:48.676241 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:48.677410 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-68bbee20-82c0-41dc-b23f-9e4317a1ed2b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.182090 Aug 26 06:24:48.677965 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 514/1038] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:48 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:49.703451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:49.704062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:49.711416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:49.711909 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:49.712342 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:49.713042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:49.713567 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:49.713978 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:50.351768 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:50.360797 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:50.362365 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:50.363639 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7774fcae-68a8-4eee-a9f3-877bc52eb0cb tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.664736 Aug 26 06:24:50.364338 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 525/1039] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:49 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:51.388748 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:51.390029 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:51.397712 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:51.397712 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:51.398190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:51.399143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:51.399603 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:51.400039 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:51.545360 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:51.555052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:51.556660 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:51.557929 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0e0de503-4251-4229-a2b3-845bb79ae8d5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1738 microversion: 2.20 time: 0.174599 Aug 26 06:24:51.558780 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 515/1040] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:51 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:52.581463 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:52.582058 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:52.588732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:52.589212 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:52.589647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:52.590337 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:52.590823 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:52.591249 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:52.594502 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=83 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:24:52.761505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:52.765049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:52.766801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:52.767776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-144ed879-0e73-4eb4-ba5d-62583c1a9c60 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1720 microversion: 2.20 time: 0.190819 Aug 26 06:24:52.768322 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 526/1041] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:52 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:53.792164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:53.792564 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:53.800945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:53.801446 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:53.801869 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:53.802567 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:53.803093 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:53.803515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:53.954972 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:53.963281 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:53.964649 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:53.965787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-754b011b-8104-4264-9a8e-22ea3bd56d1f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1720 microversion: 2.20 time: 0.178071 Aug 26 06:24:53.966335 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 516/1042] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:53 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:54.825652 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-34719793-d668-44d8-b2cc-27f09ffa27af req-59ea9d5e-d70e-4e9b-b097-4a7bf7ecaae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1", "name": "network-vif-unplugged", "status": "completed", "tag": "eae53896-6ef9-4506-ab00-a183cb7c9907"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:24:54.837591 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-34719793-d668-44d8-b2cc-27f09ffa27af req-59ea9d5e-d70e-4e9b-b097-4a7bf7ecaae5 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:54.838092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-34719793-d668-44d8-b2cc-27f09ffa27af req-59ea9d5e-d70e-4e9b-b097-4a7bf7ecaae5 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:54.838542 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-34719793-d668-44d8-b2cc-27f09ffa27af req-59ea9d5e-d70e-4e9b-b097-4a7bf7ecaae5 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:54.849637 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-34719793-d668-44d8-b2cc-27f09ffa27af req-59ea9d5e-d70e-4e9b-b097-4a7bf7ecaae5 service nova] Creating event network-vif-unplugged:eae53896-6ef9-4506-ab00-a183cb7c9907 for instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 on hv-cinder-85391 Aug 26 06:24:54.854666 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-34719793-d668-44d8-b2cc-27f09ffa27af req-59ea9d5e-d70e-4e9b-b097-4a7bf7ecaae5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032854 Aug 26 06:24:54.855329 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 527/1043] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:24:54.990035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:54.990655 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:54.996988 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:54.997466 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:54.997898 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:54.998581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:54.999803 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:55.000322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:55.148431 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:55.157200 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:55.159931 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:55.161112 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6936690f-d4e4-40e5-bc25-08e8eb75769f tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1723 microversion: 2.20 time: 0.175032 Aug 26 06:24:55.161700 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 517/1044] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:54 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:55.185707 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-03a85f56-61ad-419d-bfef-734878552eb0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea5c089b-ba9a-4fa4-a2ff-db3c49b25c0a"}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:24:55.188721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-03a85f56-61ad-419d-bfef-734878552eb0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:55.194892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03a85f56-61ad-419d-bfef-734878552eb0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:55.195379 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03a85f56-61ad-419d-bfef-734878552eb0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:55.195808 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03a85f56-61ad-419d-bfef-734878552eb0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:55.196496 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03a85f56-61ad-419d-bfef-734878552eb0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:55.196946 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03a85f56-61ad-419d-bfef-734878552eb0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:55.197365 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-03a85f56-61ad-419d-bfef-734878552eb0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:56.291565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-03a85f56-61ad-419d-bfef-734878552eb0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "POST /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.110368 Aug 26 06:24:56.293882 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 528/1045] 10.222.0.40 () {62 vars in 1364 bytes} [Fri Aug 26 06:24:55 2022] POST /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/os-volume_attachments => generated 188 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 06:24:56.420312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d0c8c04a-054c-446e-ad47-f9d748adc95e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:56.420999 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d0c8c04a-054c-446e-ad47-f9d748adc95e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:56.427602 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0c8c04a-054c-446e-ad47-f9d748adc95e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:56.428081 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0c8c04a-054c-446e-ad47-f9d748adc95e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:56.428515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0c8c04a-054c-446e-ad47-f9d748adc95e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:56.429200 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0c8c04a-054c-446e-ad47-f9d748adc95e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:56.429655 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0c8c04a-054c-446e-ad47-f9d748adc95e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:56.430075 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0c8c04a-054c-446e-ad47-f9d748adc95e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:57.868897 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d0c8c04a-054c-446e-ad47-f9d748adc95e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/os-volume_attachments/ea5c089b-ba9a-4fa4-a2ff-db3c49b25c0a" status: 202 len: 0 microversion: 2.20 time: 1.450718 Aug 26 06:24:57.868897 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 518/1046] 10.222.0.40 () {60 vars in 1457 bytes} [Fri Aug 26 06:24:56 2022] DELETE /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/os-volume_attachments/ea5c089b-ba9a-4fa4-a2ff-db3c49b25c0a => generated 0 bytes in 1452 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:24:57.930720 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-73a1e8f7-6e02-4891-b112-3791785e3e41 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:24:57.931324 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-73a1e8f7-6e02-4891-b112-3791785e3e41 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:57.938708 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-73a1e8f7-6e02-4891-b112-3791785e3e41 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:57.939201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-73a1e8f7-6e02-4891-b112-3791785e3e41 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:57.939639 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-73a1e8f7-6e02-4891-b112-3791785e3e41 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:57.940333 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-73a1e8f7-6e02-4891-b112-3791785e3e41 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:57.940792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-73a1e8f7-6e02-4891-b112-3791785e3e41 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:57.941221 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-73a1e8f7-6e02-4891-b112-3791785e3e41 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:57.985981 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-73a1e8f7-6e02-4891-b112-3791785e3e41 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121343) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 06:24:58.453969 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-73a1e8f7-6e02-4891-b112-3791785e3e41 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "POST /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/action" status: 202 len: 0 microversion: 2.20 time: 0.527163 Aug 26 06:24:58.454572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 529/1047] 10.222.0.40 () {62 vars in 1319 bytes} [Fri Aug 26 06:24:57 2022] POST /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 26 06:24:58.471069 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:58.471836 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:58.474194 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=30 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:24:58.479774 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:58.480336 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:58.480896 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:58.481636 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:58.482102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:58.482534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:58.619756 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:58.628674 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:58.630121 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:58.631263 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e638a80e-b6ad-493a-8e48-330a7d4f3d24 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1671 microversion: 2.20 time: 0.164746 Aug 26 06:24:58.631870 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 519/1048] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:58 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:24:59.654694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:24:59.655324 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:24:59.664015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:59.664694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:59.665140 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:59.665915 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:24:59.666413 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:24:59.666938 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:24:59.851716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:59.861448 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:59.862964 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:24:59.864307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e86e3f2c-0d69-48b8-966f-085232800f57 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1671 microversion: 2.20 time: 0.214373 Aug 26 06:24:59.864847 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 530/1049] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:24:59 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1671 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:00.889709 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:00.890477 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:00.899346 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:00.899827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:00.900263 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:00.900965 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:00.901415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:00.901835 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:01.052187 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:01.061098 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:01.063468 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:01.064807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-393ee74b-cf69-4373-994f-7ca723e93a01 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1671 microversion: 2.20 time: 0.180487 Aug 26 06:25:01.065803 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 520/1050] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:00 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:02.123326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:02.123326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:02.123326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:02.123326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:02.124657 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:02.124657 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:02.124657 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:02.124657 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:02.239252 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:02.247639 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:02.249609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:02.251004 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-fb0d7821-0700-40e8-8b1e-197320a93ee2 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.166932 Aug 26 06:25:02.251584 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 531/1051] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:02 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:03.277246 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:03.277885 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:03.284390 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:03.284881 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:03.285318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:03.286075 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:03.286470 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:03.286932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:03.448055 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:03.456479 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:03.457922 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:03.459145 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-50269e7a-2181-4856-b697-cda0af7b41da tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.186995 Aug 26 06:25:03.459696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 521/1052] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:03 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:04.486025 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:04.486776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:04.492881 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:25:04.495611 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:04.496344 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:04.497219 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:04.498143 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:04.498892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:04.499866 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:04.656391 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:04.667263 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:04.669145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:04.670307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-46b55c67-1801-4ff6-8a7d-591af14c43a9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.189703 Aug 26 06:25:04.672003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 532/1053] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:04 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:05.696092 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:05.697469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:05.710429 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:05.710957 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:05.711449 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:05.712131 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:05.712593 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:05.720363 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:05.881626 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:05.891829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:05.893535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:05.899318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e274ca57-d907-4f4f-b640-a07bb734b9ef tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.207191 Aug 26 06:25:05.900148 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 522/1054] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:05 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:06.925148 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:06.926007 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:06.933457 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:06.933969 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:06.934397 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:06.935411 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:06.936038 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:06.936568 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:07.180111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:07.195439 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:07.199576 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:07.201315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-12f48c5f-15ec-483c-9d7b-1218477dd44c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.281163 Aug 26 06:25:07.213824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 533/1055] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:06 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:08.228433 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:08.229031 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:08.236403 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:08.236896 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:08.237549 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:08.238268 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:08.238751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:08.241735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:08.418944 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:08.438118 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:08.440815 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:08.442706 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4b5c05a7-0e08-4903-a388-722297d53902 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.217837 Aug 26 06:25:08.444422 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 523/1056] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:08 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:09.469146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:09.469880 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:09.477121 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:09.477608 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:09.478040 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:09.478758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:09.479205 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:09.479647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:09.702779 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:09.726164 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:09.728066 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:09.729733 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-63732df5-772f-47d5-ab8f-76d3b62a20f9 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.266444 Aug 26 06:25:09.731570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 534/1057] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:09 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:10.754087 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:10.754674 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:10.763410 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:10.767318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:10.768110 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:10.769052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:10.769695 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:10.770306 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:10.930094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:10.940363 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:10.954475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:10.954475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3011d0f7-bc1a-45d4-8ad5-334760090e55 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.193279 Aug 26 06:25:10.954475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 524/1058] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:10 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:11.966123 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:11.967455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:11.975281 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:11.976196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:11.977016 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:11.978102 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:11.978789 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:11.979497 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:12.147339 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:12.159884 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:12.165974 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:12.168313 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c8cf9391-3cc0-4da5-9c54-9f4993dfea32 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.206113 Aug 26 06:25:12.169407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 535/1059] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:11 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:13.193851 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:13.194453 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:13.201194 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:13.202236 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:13.202714 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:13.203604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:13.204064 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:13.204490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:13.342511 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:13.360012 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:13.362914 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:13.364375 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d0d44729-51a2-47e6-8249-2d42c863fdb3 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.174759 Aug 26 06:25:13.365100 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 525/1060] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:13 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:14.393515 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:14.394559 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:14.404574 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:14.405626 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:14.406142 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:14.407001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:14.407455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:14.407877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:14.552686 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:14.561124 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:14.562572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:14.563827 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-64e6845b-12e0-4ceb-b319-344eb653013b tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.177925 Aug 26 06:25:14.564415 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 536/1061] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:14 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:15.589989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:15.590603 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:15.597662 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:15.598155 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:15.598595 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:15.599325 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:15.599781 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:15.600210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:15.604533 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:25:15.758898 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:15.768326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:15.770049 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:15.771323 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-95caaf91-8098-4c77-9e6d-cdac86a6c5e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.185349 Aug 26 06:25:15.771990 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 526/1062] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:15 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:16.795040 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:16.795624 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:16.802994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:16.803502 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:16.803940 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:16.804646 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:16.805142 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:16.805569 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:16.944089 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:16.952907 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:16.954356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:16.955542 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b62a01a9-2471-477f-b4e5-1ba0b6525128 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.164675 Aug 26 06:25:16.956099 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 537/1063] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:16 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:17.035463 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-4d66f6ed-7476-4a63-830a-92bfef55273f req-d15addd4-2bc6-49f9-8487-3e68463f8d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1", "name": "network-vif-plugged", "status": "completed", "tag": "eae53896-6ef9-4506-ab00-a183cb7c9907"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:25:17.050736 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-4d66f6ed-7476-4a63-830a-92bfef55273f req-d15addd4-2bc6-49f9-8487-3e68463f8d00 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:17.050736 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-4d66f6ed-7476-4a63-830a-92bfef55273f req-d15addd4-2bc6-49f9-8487-3e68463f8d00 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:17.050736 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-4d66f6ed-7476-4a63-830a-92bfef55273f req-d15addd4-2bc6-49f9-8487-3e68463f8d00 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:17.062995 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-4d66f6ed-7476-4a63-830a-92bfef55273f req-d15addd4-2bc6-49f9-8487-3e68463f8d00 service nova] Creating event network-vif-plugged:eae53896-6ef9-4506-ab00-a183cb7c9907 for instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 on hv-cinder-85391 Aug 26 06:25:17.068159 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-4d66f6ed-7476-4a63-830a-92bfef55273f req-d15addd4-2bc6-49f9-8487-3e68463f8d00 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037639 Aug 26 06:25:17.068765 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 527/1064] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:25:17.981684 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:17.982292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:17.989420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:17.989899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:17.990328 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:17.991098 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:17.991534 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:17.992002 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:18.135790 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:18.146456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:18.150306 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:18.150306 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-547a927d-72f6-4892-abef-62912eca311e tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.171400 Aug 26 06:25:18.150306 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 538/1065] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:17 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:19.174834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:19.175592 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:19.182745 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:19.183234 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:19.183665 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:19.184361 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:19.184812 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:19.185233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:19.339226 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:19.348311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:19.349819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:19.351056 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a8c463d1-4e30-4cf1-925b-8acae3180297 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.182077 Aug 26 06:25:19.351710 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 528/1066] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:19 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:20.375136 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:20.375932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:20.382769 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:20.383368 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:20.383691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:20.384391 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:20.384840 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:20.385264 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:20.520393 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:20.522669 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:25:20.529214 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:20.530727 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:20.531882 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cbd6a19d-9718-4495-b545-4c1208688da1 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1729 microversion: 2.20 time: 0.161748 Aug 26 06:25:20.532699 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 539/1067] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:20 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:25:21.556524 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:25:21.557111 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:25:21.567923 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:21.568447 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:21.568983 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:21.569686 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:25:21.570141 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:25:21.570558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:25:21.706303 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:21.714561 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:21.716039 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:25:21.717290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a537d8dd-17b6-4c1c-ab37-665955284a7a tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1716 microversion: 2.20 time: 0.164661 Aug 26 06:25:21.717931 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 529/1068] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:25:21 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1716 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:26:00.697338 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1293178359", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1551638034", "security_groups": [{"name": "tempest-secgroup-smoke-1659315665"}], "block_device_mapping_v2": [{"uuid": "7e2e95cc-0f5f-4c8b-a861-5347f7da202b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c5f68e8-9704-4e4e-a557-4e9515d804ef"}]}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:00.715218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=15 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:00.731413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6903d87b-a7be-4ca7-a7f3-055815eedd69 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:00.736819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6903d87b-a7be-4ca7-a7f3-055815eedd69 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:00.736819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=21 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:00.736819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=18 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:00.742118 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6903d87b-a7be-4ca7-a7f3-055815eedd69 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:00.742630 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6903d87b-a7be-4ca7-a7f3-055815eedd69 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:00.743099 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6903d87b-a7be-4ca7-a7f3-055815eedd69 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:00.743815 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6903d87b-a7be-4ca7-a7f3-055815eedd69 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:00.744274 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6903d87b-a7be-4ca7-a7f3-055815eedd69 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:00.744697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6903d87b-a7be-4ca7-a7f3-055815eedd69 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:00.779539 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6903d87b-a7be-4ca7-a7f3-055815eedd69 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051527 Aug 26 06:26:00.780261 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 530/1069] 10.222.0.40 () {60 vars in 1343 bytes} [Fri Aug 26 06:26:00 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:00.838673 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.network.neutron [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] validate_networks() for [('6c5f68e8-9704-4e4e-a557-4e9515d804ef', None, None, None, None, None)] {{(pid=121343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:26:00.853756 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2a509319-439e-4f7b-9ce0-6f3033aba6e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:00.854395 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2a509319-439e-4f7b-9ce0-6f3033aba6e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:00.862994 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a509319-439e-4f7b-9ce0-6f3033aba6e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:00.863594 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a509319-439e-4f7b-9ce0-6f3033aba6e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:00.864329 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a509319-439e-4f7b-9ce0-6f3033aba6e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:00.865136 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a509319-439e-4f7b-9ce0-6f3033aba6e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:00.865689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a509319-439e-4f7b-9ce0-6f3033aba6e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:00.866213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2a509319-439e-4f7b-9ce0-6f3033aba6e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:00.902581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2a509319-439e-4f7b-9ce0-6f3033aba6e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:26:01.264677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Flavor limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:26:01.264677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Image limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:26:01.264677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Flavor pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:26:01.264677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Image pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:26:01.264677 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:26:01.272610 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:01.273090 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:01.273531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:01.274250 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:01.274770 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:01.275248 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:01.295429 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Getting quotas for project fde0e661bd5646bab91b5e6b623a2e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:26:01.299693 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Getting quotas for user 2f141efe3bb74587b5ba13f0cd5d89db and project fde0e661bd5646bab91b5e6b623a2e7e. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:26:01.362994 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Going to run 1 instances... {{(pid=121343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:26:01.366726 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e2e95cc-0f5f-4c8b-a861-5347f7da202b',volume_size=None,volume_type=None)] {{(pid=121343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:26:01.381880 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2a509319-439e-4f7b-9ce0-6f3033aba6e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 204 len: 0 microversion: 2.20 time: 0.527461 Aug 26 06:26:01.381880 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 531/1070] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 26 06:26:00 2022] DELETE /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 26 06:26:01.387366 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:01.388654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:01.405129 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:01.405822 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:01.406275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:01.407237 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:01.407751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:01.408238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:01.557016 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:01.565785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:01.567310 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:01.568579 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7ddc49ec-9a6a-4f6b-85d6-7e2d8e86ea48 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.187762 Aug 26 06:26:01.569144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 532/1071] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:26:01 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 06:26:02.196280 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8650213e-0b62-40d9-8cd2-8d995358fab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.505598 Aug 26 06:26:02.196913 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 540/1072] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:26:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:26:02.208319 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a8bf6173-bf27-49c2-9371-f2c304a58c61 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:02.208934 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a8bf6173-bf27-49c2-9371-f2c304a58c61 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:02.268627 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-a8bf6173-bf27-49c2-9371-f2c304a58c61 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:02.275624 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a8bf6173-bf27-49c2-9371-f2c304a58c61 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1095 microversion: 2.1 time: 0.071064 Aug 26 06:26:02.276260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 533/1073] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:02 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:02.595343 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:02.595873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:02.603186 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:02.603673 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:02.604106 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:02.605250 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:02.605703 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:02.606135 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:02.759523 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:02.771984 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:02.773441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:02.774715 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bb51abaa-0112-47ea-a8c0-d73c80dc92ab tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1722 microversion: 2.20 time: 0.185047 Aug 26 06:26:02.775281 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 541/1074] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:26:02 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:26:03.297447 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-34291b4b-0e61-4af8-a60f-686e5c9ea063 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:03.298707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-34291b4b-0e61-4af8-a60f-686e5c9ea063 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:03.395737 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-34291b4b-0e61-4af8-a60f-686e5c9ea063 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:03.404401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-34291b4b-0e61-4af8-a60f-686e5c9ea063 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1095 microversion: 2.1 time: 0.110308 Aug 26 06:26:03.404993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 534/1075] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:03 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1095 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:03.799976 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:03.800589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:03.806947 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:03.807425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:03.807864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:03.808549 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:03.808995 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:03.809411 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:03.904080 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:03.918056 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:03.920429 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:03.921624 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f0887106-da96-4201-bdc5-ed0238f3a0b0 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1655 microversion: 2.20 time: 0.125768 Aug 26 06:26:03.922381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 542/1076] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:26:03 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1655 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:26:03.990334 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-c7cd53a4-a37a-4231-9a4c-568938605215 req-0c9cbf3f-13fd-4dd3-be77-146347e7fc16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1", "name": "network-vif-deleted", "tag": "eae53896-6ef9-4506-ab00-a183cb7c9907"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:04.000124 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c7cd53a4-a37a-4231-9a4c-568938605215 req-0c9cbf3f-13fd-4dd3-be77-146347e7fc16 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:04.000801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c7cd53a4-a37a-4231-9a4c-568938605215 req-0c9cbf3f-13fd-4dd3-be77-146347e7fc16 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:04.001305 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c7cd53a4-a37a-4231-9a4c-568938605215 req-0c9cbf3f-13fd-4dd3-be77-146347e7fc16 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:04.015420 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-c7cd53a4-a37a-4231-9a4c-568938605215 req-0c9cbf3f-13fd-4dd3-be77-146347e7fc16 service nova] Creating event network-vif-deleted:eae53896-6ef9-4506-ab00-a183cb7c9907 for instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 on hv-cinder-85391 Aug 26 06:26:04.021790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-c7cd53a4-a37a-4231-9a4c-568938605215 req-0c9cbf3f-13fd-4dd3-be77-146347e7fc16 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035092 Aug 26 06:26:04.022706 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 535/1077] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:26:04.439067 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0682a79a-b1b1-4b16-a372-2b9a17686a85 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:04.439692 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0682a79a-b1b1-4b16-a372-2b9a17686a85 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:04.556734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0682a79a-b1b1-4b16-a372-2b9a17686a85 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:04.556734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0682a79a-b1b1-4b16-a372-2b9a17686a85 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1095 microversion: 2.1 time: 0.108360 Aug 26 06:26:04.556734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 543/1078] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:04 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1095 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:04.950108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:04.951493 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:04.958381 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:04.958896 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:04.967246 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:04.967246 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:04.967246 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:04.967246 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:04.996819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:04.998109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:04.998378 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:04.998916 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lazy-loading 'fault' on Instance uuid ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:26:05.045271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:05.055780 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:05.057365 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '660c6df77d0a4750aac30345d6768526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7e0c375a58842e18a4306779fd6e167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:05.058652 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0cc33fff-e407-433c-9341-e0ed0cb2b215 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 200 len: 1371 microversion: 2.20 time: 0.113388 Aug 26 06:26:05.062342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 536/1079] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:26:04 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 06:26:05.556209 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-dcbf80f9-4a74-4f0e-8e08-e077da0ce98c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:05.556792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-dcbf80f9-4a74-4f0e-8e08-e077da0ce98c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:05.614302 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-dcbf80f9-4a74-4f0e-8e08-e077da0ce98c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:05.621378 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-dcbf80f9-4a74-4f0e-8e08-e077da0ce98c tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1095 microversion: 2.1 time: 0.069125 Aug 26 06:26:05.621958 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 544/1080] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:05 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:06.083637 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:06.084233 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:06.094247 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:06.094815 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:06.095265 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:06.096037 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:06.096520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:06.096953 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:06.111804 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] HTTP exception thrown: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Request method failure captured: Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 HTTP/1.1 Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGWutM-sLT0NZtBZswCfyB5Brh2v35yolGm0RJm3JvSkiPzE5IpNeA4cCtaPPp0h3bow4W9mMFhie80VCAm2mwFxWvIPyK63YBAIl18RNDSFNAhwyq7QEvZBcnzv7M9Qcf53QnIfe0xfaZMMBjqYPGZOubwo-naAdzAfMeJKbO21jLY Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:26:06.113490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 660c6df77d0a4750aac30345d6768526 Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:06.115383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1'} Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:26:06.116450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:06.117798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:06.119148 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Returning 404 to user: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:26:06.119148 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1be3b0d9-06e3-4196-941b-dc5d7a7b618c tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 404 len: 111 microversion: 2.20 time: 0.035227 Aug 26 06:26:06.119148 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 537/1081] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:26:06 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 06:26:06.124137 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8efc212f-aaff-4b3e-8883-befda60408e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '.version_select at 0x7f2f08fd5700>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:06.223606 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8efc212f-aaff-4b3e-8883-befda60408e8 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447197145" status: 204 len: 0 microversion: 2.20 time: 0.103240 Aug 26 06:26:06.224306 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 545/1082] 10.222.0.40 () {60 vars in 1262 bytes} [Fri Aug 26 06:26:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447197145 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 06:26:06.301326 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-500932d8-9788-4dea-a24d-78de95a0dcd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:06.301921 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-500932d8-9788-4dea-a24d-78de95a0dcd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:06.308269 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-500932d8-9788-4dea-a24d-78de95a0dcd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:06.308800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-500932d8-9788-4dea-a24d-78de95a0dcd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:06.309407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-500932d8-9788-4dea-a24d-78de95a0dcd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:06.310255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-500932d8-9788-4dea-a24d-78de95a0dcd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:06.310753 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-500932d8-9788-4dea-a24d-78de95a0dcd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:06.311290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-500932d8-9788-4dea-a24d-78de95a0dcd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:06.338806 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-500932d8-9788-4dea-a24d-78de95a0dcd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lazy-loading 'flavor' on Instance uuid 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:26:06.657235 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-33e2d324-6671-4054-a07d-a32abd17dc24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:06.658283 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-33e2d324-6671-4054-a07d-a32abd17dc24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:06.669238 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33e2d324-6671-4054-a07d-a32abd17dc24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:06.669663 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33e2d324-6671-4054-a07d-a32abd17dc24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:06.670120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33e2d324-6671-4054-a07d-a32abd17dc24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:06.671067 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33e2d324-6671-4054-a07d-a32abd17dc24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:06.671597 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33e2d324-6671-4054-a07d-a32abd17dc24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:06.672798 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-33e2d324-6671-4054-a07d-a32abd17dc24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:06.744588 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-33e2d324-6671-4054-a07d-a32abd17dc24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:06.753876 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-33e2d324-6671-4054-a07d-a32abd17dc24 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1145 microversion: 2.1 time: 0.112925 Aug 26 06:26:06.754453 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 546/1083] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:06 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1145 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:06.823435 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-500932d8-9788-4dea-a24d-78de95a0dcd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "POST /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0/action" status: 202 len: 0 microversion: 2.1 time: 0.526168 Aug 26 06:26:06.823965 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 538/1084] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:26:06 2022] POST /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:26:06.833531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-75b99215-56e0-45e9-ac11-f50900b32622 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:06.834457 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-75b99215-56e0-45e9-ac11-f50900b32622 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:06.840644 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-75b99215-56e0-45e9-ac11-f50900b32622 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:06.841956 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-75b99215-56e0-45e9-ac11-f50900b32622 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:06.842398 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-75b99215-56e0-45e9-ac11-f50900b32622 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:06.853184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-75b99215-56e0-45e9-ac11-f50900b32622 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:06.853184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-75b99215-56e0-45e9-ac11-f50900b32622 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:06.853184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-75b99215-56e0-45e9-ac11-f50900b32622 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:06.997999 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-75b99215-56e0-45e9-ac11-f50900b32622 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:07.006506 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-75b99215-56e0-45e9-ac11-f50900b32622 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.177161 Aug 26 06:26:07.007153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 547/1085] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:06 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:07.776942 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-bd2d7f0f-9506-4671-839e-fdc52984b183 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:07.777687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-bd2d7f0f-9506-4671-839e-fdc52984b183 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:07.784771 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd2d7f0f-9506-4671-839e-fdc52984b183 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:07.785273 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd2d7f0f-9506-4671-839e-fdc52984b183 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:07.785727 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd2d7f0f-9506-4671-839e-fdc52984b183 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:07.786429 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd2d7f0f-9506-4671-839e-fdc52984b183 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:07.786943 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd2d7f0f-9506-4671-839e-fdc52984b183 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:07.787380 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bd2d7f0f-9506-4671-839e-fdc52984b183 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:07.858162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-bd2d7f0f-9506-4671-839e-fdc52984b183 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:07.866283 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-bd2d7f0f-9506-4671-839e-fdc52984b183 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1145 microversion: 2.1 time: 0.094001 Aug 26 06:26:07.866991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 539/1086] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:07 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:08.038771 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ff639a56-2e2f-421f-b42d-f59f34e4680a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:08.039629 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ff639a56-2e2f-421f-b42d-f59f34e4680a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:08.051260 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ff639a56-2e2f-421f-b42d-f59f34e4680a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:08.052011 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ff639a56-2e2f-421f-b42d-f59f34e4680a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:08.052455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ff639a56-2e2f-421f-b42d-f59f34e4680a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:08.053165 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ff639a56-2e2f-421f-b42d-f59f34e4680a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:08.053627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ff639a56-2e2f-421f-b42d-f59f34e4680a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:08.054053 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ff639a56-2e2f-421f-b42d-f59f34e4680a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:08.205627 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ff639a56-2e2f-421f-b42d-f59f34e4680a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:08.216535 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ff639a56-2e2f-421f-b42d-f59f34e4680a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.182178 Aug 26 06:26:08.217117 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 548/1087] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:08 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:08.768331 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:08.768834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:08.775732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:08.775885 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:08.776284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:08.777021 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:08.779818 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:08.779818 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:08.792491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] HTTP exception thrown: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Request method failure captured: Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: DELETE /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 HTTP/1.1 Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGWutM-sLT0NZtBZswCfyB5Brh2v35yolGm0RJm3JvSkiPzE5IpNeA4cCtaPPp0h3bow4W9mMFhie80VCAm2mwFxWvIPyK63YBAIl18RNDSFNAhwyq7QEvZBcnzv7M9Qcf53QnIfe0xfaZMMBjqYPGZOubwo-naAdzAfMeJKbO21jLY Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:26:08.794271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 660c6df77d0a4750aac30345d6768526 Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:08.796318 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1'} Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:26:08.797213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:08.798732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:08.800180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Returning 404 to user: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:26:08.800180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-726a23eb-c5f4-434c-8fdd-36048bfba052 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 404 len: 111 microversion: 2.20 time: 0.031326 Aug 26 06:26:08.800180 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 540/1088] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 26 06:26:08 2022] DELETE /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 26 06:26:08.804504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:08.805116 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:08.811179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:08.811662 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:08.812102 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:08.812800 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:08.813253 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:08.813690 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:08.828266 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] HTTP exception thrown: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Request method failure captured: Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 HTTP/1.1 Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGWutM-sLT0NZtBZswCfyB5Brh2v35yolGm0RJm3JvSkiPzE5IpNeA4cCtaPPp0h3bow4W9mMFhie80VCAm2mwFxWvIPyK63YBAIl18RNDSFNAhwyq7QEvZBcnzv7M9Qcf53QnIfe0xfaZMMBjqYPGZOubwo-naAdzAfMeJKbO21jLY Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:26:08.829935 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 660c6df77d0a4750aac30345d6768526 Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:08.831672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1'} Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:26:08.832544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. Aug 26 06:26:08.834694 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:26:08.836092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Returning 404 to user: Instance ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:26:08.836092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-78278120-06f5-4932-8356-3c04cfa79d68 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1" status: 404 len: 111 microversion: 2.20 time: 0.030991 Aug 26 06:26:08.836092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 549/1089] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:26:08 2022] GET /compute/v2.1/servers/ab12c6ba-bfc2-4ac2-b226-f45d1428bfa1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 06:26:08.888737 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-33d7f273-02b8-45a3-8a58-ed600805e322 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:08.889445 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-33d7f273-02b8-45a3-8a58-ed600805e322 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:08.895869 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-33d7f273-02b8-45a3-8a58-ed600805e322 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:08.896363 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-33d7f273-02b8-45a3-8a58-ed600805e322 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:08.896811 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-33d7f273-02b8-45a3-8a58-ed600805e322 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:08.897520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-33d7f273-02b8-45a3-8a58-ed600805e322 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:08.898226 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-33d7f273-02b8-45a3-8a58-ed600805e322 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:08.898393 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-33d7f273-02b8-45a3-8a58-ed600805e322 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:08.963008 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-33d7f273-02b8-45a3-8a58-ed600805e322 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:08.972288 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-33d7f273-02b8-45a3-8a58-ed600805e322 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1193 microversion: 2.1 time: 0.088269 Aug 26 06:26:08.972860 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 541/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:08 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:09.237996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9f518c24-6fc2-4d96-8f3c-f3fea06e527a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:09.238739 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9f518c24-6fc2-4d96-8f3c-f3fea06e527a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:09.250206 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f518c24-6fc2-4d96-8f3c-f3fea06e527a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:09.250880 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f518c24-6fc2-4d96-8f3c-f3fea06e527a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:09.251456 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f518c24-6fc2-4d96-8f3c-f3fea06e527a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:09.252201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f518c24-6fc2-4d96-8f3c-f3fea06e527a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:09.252801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f518c24-6fc2-4d96-8f3c-f3fea06e527a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:09.253473 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f518c24-6fc2-4d96-8f3c-f3fea06e527a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:09.438093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9f518c24-6fc2-4d96-8f3c-f3fea06e527a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:09.442476 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9f518c24-6fc2-4d96-8f3c-f3fea06e527a tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.208797 Aug 26 06:26:09.443113 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 550/1091] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:09 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:09.995308 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3519517e-50bd-4f31-a349-80c755d0adbd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:09.996228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3519517e-50bd-4f31-a349-80c755d0adbd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:10.005660 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3519517e-50bd-4f31-a349-80c755d0adbd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:10.006150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3519517e-50bd-4f31-a349-80c755d0adbd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:10.006586 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3519517e-50bd-4f31-a349-80c755d0adbd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:10.007322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3519517e-50bd-4f31-a349-80c755d0adbd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:10.008737 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3519517e-50bd-4f31-a349-80c755d0adbd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:10.009170 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3519517e-50bd-4f31-a349-80c755d0adbd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:10.082134 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3519517e-50bd-4f31-a349-80c755d0adbd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:10.093389 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3519517e-50bd-4f31-a349-80c755d0adbd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1211 microversion: 2.1 time: 0.103093 Aug 26 06:26:10.095081 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 542/1092] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:09 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:10.346779 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:10.347332 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:10.354716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:10.355202 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:10.355842 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:10.357047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:10.357505 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:10.357930 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:10.371983 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] HTTP exception thrown: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Request method failure captured: Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: DELETE /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c HTTP/1.1 Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGWutM-sLT0NZtBZswCfyB5Brh2v35yolGm0RJm3JvSkiPzE5IpNeA4cCtaPPp0h3bow4W9mMFhie80VCAm2mwFxWvIPyK63YBAIl18RNDSFNAhwyq7QEvZBcnzv7M9Qcf53QnIfe0xfaZMMBjqYPGZOubwo-naAdzAfMeJKbO21jLY Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:26:10.377375 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 660c6df77d0a4750aac30345d6768526 Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:26:10.379577 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c'} Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:26:10.380555 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:26:10.382006 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:26:10.383821 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Returning 404 to user: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:26:10.383821 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-bd777c67-29b8-4689-b2aa-b4db7fb66bd5 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 404 len: 111 microversion: 2.20 time: 0.033142 Aug 26 06:26:10.383821 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 551/1093] 10.222.0.40 () {60 vars in 1280 bytes} [Fri Aug 26 06:26:10 2022] DELETE /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 06:26:10.404109 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:10.404726 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] [instance: ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:10.417711 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:10.417711 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:10.417711 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:10.417711 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:10.418210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:10.418210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:10.438303 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] HTTP exception thrown: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Request method failure captured: Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c HTTP/1.1 Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGWutM-sLT0NZtBZswCfyB5Brh2v35yolGm0RJm3JvSkiPzE5IpNeA4cCtaPPp0h3bow4W9mMFhie80VCAm2mwFxWvIPyK63YBAIl18RNDSFNAhwyq7QEvZBcnzv7M9Qcf53QnIfe0xfaZMMBjqYPGZOubwo-naAdzAfMeJKbO21jLY Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:26:10.439980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f7e0c375a58842e18a4306779fd6e167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: f7e0c375a58842e18a4306779fd6e167 Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1001120803 Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 660c6df77d0a4750aac30345d6768526 Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1001120803-project Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:26:10.441675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c'} Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:26:10.442491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. Aug 26 06:26:10.444750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:26:10.446694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] Returning 404 to user: Instance ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:26:10.446694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-270d0c9e-e831-43b3-9183-e6f4b6c5dd77 tempest-AttachVolumeShelveTestJSON-1001120803 tempest-AttachVolumeShelveTestJSON-1001120803-project] 10.222.0.40 "GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c" status: 404 len: 111 microversion: 2.20 time: 0.041685 Aug 26 06:26:10.446694 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 543/1094] 10.222.0.40 () {60 vars in 1277 bytes} [Fri Aug 26 06:26:10 2022] GET /compute/v2.1/servers/ea17388a-9fbb-4e6a-93b9-242b6c7cbd4c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 06:26:10.468831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4328752e-4822-4ea8-80c0-6a5d1e120be6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:10.469952 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4328752e-4822-4ea8-80c0-6a5d1e120be6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:10.477921 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4328752e-4822-4ea8-80c0-6a5d1e120be6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:10.478646 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4328752e-4822-4ea8-80c0-6a5d1e120be6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:10.479266 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4328752e-4822-4ea8-80c0-6a5d1e120be6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:10.480741 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4328752e-4822-4ea8-80c0-6a5d1e120be6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:10.482655 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4328752e-4822-4ea8-80c0-6a5d1e120be6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:10.483436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4328752e-4822-4ea8-80c0-6a5d1e120be6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:10.670210 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4328752e-4822-4ea8-80c0-6a5d1e120be6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:10.680651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4328752e-4822-4ea8-80c0-6a5d1e120be6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.216684 Aug 26 06:26:10.681882 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 552/1095] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:10 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:11.130972 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5e229d17-0c03-4fcb-aa56-600dbf1ac8b7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:11.131677 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5e229d17-0c03-4fcb-aa56-600dbf1ac8b7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:11.139034 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e229d17-0c03-4fcb-aa56-600dbf1ac8b7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:11.139554 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e229d17-0c03-4fcb-aa56-600dbf1ac8b7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:11.140014 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e229d17-0c03-4fcb-aa56-600dbf1ac8b7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:11.140731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e229d17-0c03-4fcb-aa56-600dbf1ac8b7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:11.141192 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e229d17-0c03-4fcb-aa56-600dbf1ac8b7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:11.141643 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e229d17-0c03-4fcb-aa56-600dbf1ac8b7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:11.536322 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5e229d17-0c03-4fcb-aa56-600dbf1ac8b7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:11.544811 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5e229d17-0c03-4fcb-aa56-600dbf1ac8b7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1279 microversion: 2.1 time: 0.417839 Aug 26 06:26:11.545513 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 544/1096] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:11 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1279 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:11.611536 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-9394f7a8-2c5e-44d8-a9f5-26b289ffa64e req-a9e3af16-e628-4362-82fa-a478ef7a3777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e760f027-a590-4387-ab32-7dca29d29335", "tag": "ab5e913e-41a3-4c93-830a-f63879ab1522"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:11.616668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:11.624447 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-9394f7a8-2c5e-44d8-a9f5-26b289ffa64e req-a9e3af16-e628-4362-82fa-a478ef7a3777 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:11.625321 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-9394f7a8-2c5e-44d8-a9f5-26b289ffa64e req-a9e3af16-e628-4362-82fa-a478ef7a3777 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:11.625940 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-9394f7a8-2c5e-44d8-a9f5-26b289ffa64e req-a9e3af16-e628-4362-82fa-a478ef7a3777 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:11.643021 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-9394f7a8-2c5e-44d8-a9f5-26b289ffa64e req-a9e3af16-e628-4362-82fa-a478ef7a3777 service nova] Creating event network-changed:ab5e913e-41a3-4c93-830a-f63879ab1522 for instance e760f027-a590-4387-ab32-7dca29d29335 on hv-cinder-85391 Aug 26 06:26:11.646676 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-9394f7a8-2c5e-44d8-a9f5-26b289ffa64e req-a9e3af16-e628-4362-82fa-a478ef7a3777 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040988 Aug 26 06:26:11.647611 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 553/1097] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:26:11.706875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b19aa8da-a4fe-4aa6-988a-4e7e2409b420 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:11.707807 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b19aa8da-a4fe-4aa6-988a-4e7e2409b420 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:11.715164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b19aa8da-a4fe-4aa6-988a-4e7e2409b420 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:11.715759 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b19aa8da-a4fe-4aa6-988a-4e7e2409b420 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:11.716358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b19aa8da-a4fe-4aa6-988a-4e7e2409b420 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:11.717362 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b19aa8da-a4fe-4aa6-988a-4e7e2409b420 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:11.717867 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b19aa8da-a4fe-4aa6-988a-4e7e2409b420 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:11.718260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b19aa8da-a4fe-4aa6-988a-4e7e2409b420 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:11.984442 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b19aa8da-a4fe-4aa6-988a-4e7e2409b420 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:11.993279 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b19aa8da-a4fe-4aa6-988a-4e7e2409b420 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.290567 Aug 26 06:26:12.001596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 545/1098] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:11 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:12.568373 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9f9f4bb4-d72d-40e2-821c-d33e5db4c466 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:12.569061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9f9f4bb4-d72d-40e2-821c-d33e5db4c466 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:12.576457 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f9f4bb4-d72d-40e2-821c-d33e5db4c466 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:12.576947 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f9f4bb4-d72d-40e2-821c-d33e5db4c466 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:12.577384 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f9f4bb4-d72d-40e2-821c-d33e5db4c466 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:12.578084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f9f4bb4-d72d-40e2-821c-d33e5db4c466 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:12.578600 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f9f4bb4-d72d-40e2-821c-d33e5db4c466 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:12.578981 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9f9f4bb4-d72d-40e2-821c-d33e5db4c466 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:12.738190 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-9f9f4bb4-d72d-40e2-821c-d33e5db4c466 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:12.747021 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9f9f4bb4-d72d-40e2-821c-d33e5db4c466 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.183160 Aug 26 06:26:12.748223 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 554/1099] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:12 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:13.015416 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ebb6bd75-369c-4fbc-92e4-d87c28076793 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:13.016129 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ebb6bd75-369c-4fbc-92e4-d87c28076793 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:13.023205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb6bd75-369c-4fbc-92e4-d87c28076793 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:13.023690 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb6bd75-369c-4fbc-92e4-d87c28076793 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:13.024123 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb6bd75-369c-4fbc-92e4-d87c28076793 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:13.031989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb6bd75-369c-4fbc-92e4-d87c28076793 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:13.031989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb6bd75-369c-4fbc-92e4-d87c28076793 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:13.031989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebb6bd75-369c-4fbc-92e4-d87c28076793 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:13.322207 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ebb6bd75-369c-4fbc-92e4-d87c28076793 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:13.337260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ebb6bd75-369c-4fbc-92e4-d87c28076793 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.322397 Aug 26 06:26:13.343532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 546/1100] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:13 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:13.772846 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a53cb290-f9ef-4fc8-8707-629fa0dc31cd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:13.773518 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a53cb290-f9ef-4fc8-8707-629fa0dc31cd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:13.780155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a53cb290-f9ef-4fc8-8707-629fa0dc31cd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:13.782862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a53cb290-f9ef-4fc8-8707-629fa0dc31cd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:13.782862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a53cb290-f9ef-4fc8-8707-629fa0dc31cd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:13.782862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a53cb290-f9ef-4fc8-8707-629fa0dc31cd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:13.782862 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a53cb290-f9ef-4fc8-8707-629fa0dc31cd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:13.783738 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a53cb290-f9ef-4fc8-8707-629fa0dc31cd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:13.953397 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a53cb290-f9ef-4fc8-8707-629fa0dc31cd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:13.962581 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a53cb290-f9ef-4fc8-8707-629fa0dc31cd tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.193558 Aug 26 06:26:13.963245 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 555/1101] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:13 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:14.355890 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c90c1afb-b063-4803-a6e3-83cb96a20e6c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:14.356646 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c90c1afb-b063-4803-a6e3-83cb96a20e6c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:14.359623 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=4 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:14.365571 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c90c1afb-b063-4803-a6e3-83cb96a20e6c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:14.366185 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c90c1afb-b063-4803-a6e3-83cb96a20e6c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:14.366804 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c90c1afb-b063-4803-a6e3-83cb96a20e6c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:14.367966 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c90c1afb-b063-4803-a6e3-83cb96a20e6c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:14.368535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c90c1afb-b063-4803-a6e3-83cb96a20e6c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:14.369099 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c90c1afb-b063-4803-a6e3-83cb96a20e6c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:14.375133 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:14.515895 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c90c1afb-b063-4803-a6e3-83cb96a20e6c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:14.524604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c90c1afb-b063-4803-a6e3-83cb96a20e6c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.172770 Aug 26 06:26:14.536341 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 547/1102] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:14 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:14.985398 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-06b72e19-3b7f-4f38-a024-389e1ea90e45 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:14.985978 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-06b72e19-3b7f-4f38-a024-389e1ea90e45 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:14.992872 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06b72e19-3b7f-4f38-a024-389e1ea90e45 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:14.993370 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06b72e19-3b7f-4f38-a024-389e1ea90e45 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:14.993814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06b72e19-3b7f-4f38-a024-389e1ea90e45 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:14.994514 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06b72e19-3b7f-4f38-a024-389e1ea90e45 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:14.995010 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06b72e19-3b7f-4f38-a024-389e1ea90e45 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:14.995483 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-06b72e19-3b7f-4f38-a024-389e1ea90e45 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:15.191117 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-06b72e19-3b7f-4f38-a024-389e1ea90e45 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:15.198993 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-06b72e19-3b7f-4f38-a024-389e1ea90e45 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.218925 Aug 26 06:26:15.199569 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 556/1103] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:14 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:15.546240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2483733a-2623-4f5d-ace8-438e45094184 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:15.546865 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2483733a-2623-4f5d-ace8-438e45094184 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:15.556250 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2483733a-2623-4f5d-ace8-438e45094184 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:15.556783 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2483733a-2623-4f5d-ace8-438e45094184 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:15.557280 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2483733a-2623-4f5d-ace8-438e45094184 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:15.558000 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2483733a-2623-4f5d-ace8-438e45094184 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:15.558491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2483733a-2623-4f5d-ace8-438e45094184 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:15.558973 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2483733a-2623-4f5d-ace8-438e45094184 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:15.708467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2483733a-2623-4f5d-ace8-438e45094184 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:15.716976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2483733a-2623-4f5d-ace8-438e45094184 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.174612 Aug 26 06:26:15.717554 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 548/1104] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:15 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:16.222195 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-70d42c1e-1067-4bae-8542-b1c3a0a24b97 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:16.222821 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-70d42c1e-1067-4bae-8542-b1c3a0a24b97 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:16.224765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=10 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:16.230467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-70d42c1e-1067-4bae-8542-b1c3a0a24b97 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:16.230846 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-70d42c1e-1067-4bae-8542-b1c3a0a24b97 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:16.231277 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-70d42c1e-1067-4bae-8542-b1c3a0a24b97 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:16.232462 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-70d42c1e-1067-4bae-8542-b1c3a0a24b97 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:16.232912 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-70d42c1e-1067-4bae-8542-b1c3a0a24b97 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:16.233337 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-70d42c1e-1067-4bae-8542-b1c3a0a24b97 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:16.391695 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-70d42c1e-1067-4bae-8542-b1c3a0a24b97 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:16.400156 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-70d42c1e-1067-4bae-8542-b1c3a0a24b97 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.181793 Aug 26 06:26:16.400831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 557/1105] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:16 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:16.739890 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-072c4c36-5639-4cb2-8486-6447da0666e6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:16.740740 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-072c4c36-5639-4cb2-8486-6447da0666e6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:16.753560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-072c4c36-5639-4cb2-8486-6447da0666e6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:16.754413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-072c4c36-5639-4cb2-8486-6447da0666e6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:16.755223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-072c4c36-5639-4cb2-8486-6447da0666e6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:16.756286 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-072c4c36-5639-4cb2-8486-6447da0666e6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:16.757864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-072c4c36-5639-4cb2-8486-6447da0666e6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:16.758777 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-072c4c36-5639-4cb2-8486-6447da0666e6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:16.936792 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-072c4c36-5639-4cb2-8486-6447da0666e6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:16.946171 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-072c4c36-5639-4cb2-8486-6447da0666e6 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.212507 Aug 26 06:26:16.946910 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 549/1106] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:16 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:17.425821 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-26818581-8cc1-47ef-ba8e-a61535f22bed tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:17.427145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-26818581-8cc1-47ef-ba8e-a61535f22bed tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:17.446768 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26818581-8cc1-47ef-ba8e-a61535f22bed tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:17.446768 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26818581-8cc1-47ef-ba8e-a61535f22bed tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:17.446768 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26818581-8cc1-47ef-ba8e-a61535f22bed tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:17.446768 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26818581-8cc1-47ef-ba8e-a61535f22bed tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:17.448042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26818581-8cc1-47ef-ba8e-a61535f22bed tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:17.448042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-26818581-8cc1-47ef-ba8e-a61535f22bed tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:17.701322 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-26818581-8cc1-47ef-ba8e-a61535f22bed tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:17.715599 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-26818581-8cc1-47ef-ba8e-a61535f22bed tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.294996 Aug 26 06:26:17.720140 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 558/1107] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:17 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:17.975863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-21eb0cfc-3055-4795-baf4-b49972db7ed3 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:17.975863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-21eb0cfc-3055-4795-baf4-b49972db7ed3 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:17.978655 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21eb0cfc-3055-4795-baf4-b49972db7ed3 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:17.979491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21eb0cfc-3055-4795-baf4-b49972db7ed3 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:17.980599 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21eb0cfc-3055-4795-baf4-b49972db7ed3 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:17.982262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21eb0cfc-3055-4795-baf4-b49972db7ed3 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:17.982880 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21eb0cfc-3055-4795-baf4-b49972db7ed3 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:17.983413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-21eb0cfc-3055-4795-baf4-b49972db7ed3 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:18.126017 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-21eb0cfc-3055-4795-baf4-b49972db7ed3 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:18.134933 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-21eb0cfc-3055-4795-baf4-b49972db7ed3 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.169463 Aug 26 06:26:18.135512 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 550/1108] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:17 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:18.739968 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7a6bf630-594a-4c0d-9d46-9198ced510e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:18.740702 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7a6bf630-594a-4c0d-9d46-9198ced510e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:18.748095 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a6bf630-594a-4c0d-9d46-9198ced510e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:18.748843 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a6bf630-594a-4c0d-9d46-9198ced510e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:18.749290 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a6bf630-594a-4c0d-9d46-9198ced510e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:18.750003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a6bf630-594a-4c0d-9d46-9198ced510e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:18.750458 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a6bf630-594a-4c0d-9d46-9198ced510e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:18.750912 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7a6bf630-594a-4c0d-9d46-9198ced510e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:18.924017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7a6bf630-594a-4c0d-9d46-9198ced510e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:18.933184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7a6bf630-594a-4c0d-9d46-9198ced510e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.196996 Aug 26 06:26:18.933800 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 559/1109] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:18 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:19.161844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-074c745b-85d7-4c1a-a871-a68751277c81 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:19.163050 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-074c745b-85d7-4c1a-a871-a68751277c81 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:19.170408 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-074c745b-85d7-4c1a-a871-a68751277c81 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:19.170947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-074c745b-85d7-4c1a-a871-a68751277c81 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:19.171385 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-074c745b-85d7-4c1a-a871-a68751277c81 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:19.172093 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-074c745b-85d7-4c1a-a871-a68751277c81 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:19.172550 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-074c745b-85d7-4c1a-a871-a68751277c81 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:19.172977 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-074c745b-85d7-4c1a-a871-a68751277c81 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:19.332289 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-074c745b-85d7-4c1a-a871-a68751277c81 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:19.341565 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-074c745b-85d7-4c1a-a871-a68751277c81 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.186005 Aug 26 06:26:19.342735 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 551/1110] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:19 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:19.956112 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3ce168b8-7a9d-4aab-ae51-5152e9f7b3be tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:19.956973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3ce168b8-7a9d-4aab-ae51-5152e9f7b3be tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:19.963746 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3ce168b8-7a9d-4aab-ae51-5152e9f7b3be tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:19.964400 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3ce168b8-7a9d-4aab-ae51-5152e9f7b3be tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:19.965133 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3ce168b8-7a9d-4aab-ae51-5152e9f7b3be tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:19.966867 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3ce168b8-7a9d-4aab-ae51-5152e9f7b3be tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:19.967466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3ce168b8-7a9d-4aab-ae51-5152e9f7b3be tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:19.968008 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3ce168b8-7a9d-4aab-ae51-5152e9f7b3be tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:20.117959 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3ce168b8-7a9d-4aab-ae51-5152e9f7b3be tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:20.120909 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3ce168b8-7a9d-4aab-ae51-5152e9f7b3be tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.169024 Aug 26 06:26:20.121474 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 560/1111] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:19 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:20.369457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-def7a359-f56d-4c86-a511-c2184ad9efd4 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:20.369457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-def7a359-f56d-4c86-a511-c2184ad9efd4 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:20.371183 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-def7a359-f56d-4c86-a511-c2184ad9efd4 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:20.371681 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-def7a359-f56d-4c86-a511-c2184ad9efd4 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:20.373375 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-def7a359-f56d-4c86-a511-c2184ad9efd4 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:20.374246 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-def7a359-f56d-4c86-a511-c2184ad9efd4 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:20.374731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-def7a359-f56d-4c86-a511-c2184ad9efd4 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:20.375162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-def7a359-f56d-4c86-a511-c2184ad9efd4 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:20.523107 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-def7a359-f56d-4c86-a511-c2184ad9efd4 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:20.531923 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-def7a359-f56d-4c86-a511-c2184ad9efd4 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.172282 Aug 26 06:26:20.532592 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 552/1112] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:20 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:21.143850 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-36737e5d-7dab-4d7b-9a2b-ee1895380692 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:21.144519 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-36737e5d-7dab-4d7b-9a2b-ee1895380692 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:21.151232 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36737e5d-7dab-4d7b-9a2b-ee1895380692 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:21.154358 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36737e5d-7dab-4d7b-9a2b-ee1895380692 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:21.154358 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36737e5d-7dab-4d7b-9a2b-ee1895380692 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:21.154358 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36737e5d-7dab-4d7b-9a2b-ee1895380692 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:21.154358 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36737e5d-7dab-4d7b-9a2b-ee1895380692 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:21.154979 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-36737e5d-7dab-4d7b-9a2b-ee1895380692 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:21.291068 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-c869e100-601a-4c0e-81de-a580323f3ccd req-39d661a1-f440-463a-bb96-6428252811a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4228acc2-99a7-47c3-9cef-92c0f7bcb7b0", "name": "network-vif-unplugged", "status": "completed", "tag": "16e251e3-f929-404a-95a5-e7b555e4782f"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:21.314419 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c869e100-601a-4c0e-81de-a580323f3ccd req-39d661a1-f440-463a-bb96-6428252811a0 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:21.314965 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c869e100-601a-4c0e-81de-a580323f3ccd req-39d661a1-f440-463a-bb96-6428252811a0 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:21.316048 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c869e100-601a-4c0e-81de-a580323f3ccd req-39d661a1-f440-463a-bb96-6428252811a0 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:21.330054 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-c869e100-601a-4c0e-81de-a580323f3ccd req-39d661a1-f440-463a-bb96-6428252811a0 service nova] Creating event network-vif-unplugged:16e251e3-f929-404a-95a5-e7b555e4782f for instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 on hv-cinder-85391 Aug 26 06:26:21.335970 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-c869e100-601a-4c0e-81de-a580323f3ccd req-39d661a1-f440-463a-bb96-6428252811a0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048429 Aug 26 06:26:21.336581 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 553/1113] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:26:21.471161 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-36737e5d-7dab-4d7b-9a2b-ee1895380692 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:21.483455 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-36737e5d-7dab-4d7b-9a2b-ee1895380692 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.343582 Aug 26 06:26:21.484050 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 561/1114] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:21 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:21.555758 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-61cc9cc2-0524-4810-aff7-dd7dc66c0576 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:21.556474 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-61cc9cc2-0524-4810-aff7-dd7dc66c0576 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:21.564725 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-61cc9cc2-0524-4810-aff7-dd7dc66c0576 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:21.565218 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-61cc9cc2-0524-4810-aff7-dd7dc66c0576 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:21.565839 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-61cc9cc2-0524-4810-aff7-dd7dc66c0576 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:21.567074 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-61cc9cc2-0524-4810-aff7-dd7dc66c0576 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:21.567540 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-61cc9cc2-0524-4810-aff7-dd7dc66c0576 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:21.568188 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-61cc9cc2-0524-4810-aff7-dd7dc66c0576 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:21.732051 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-61cc9cc2-0524-4810-aff7-dd7dc66c0576 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:21.744028 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-61cc9cc2-0524-4810-aff7-dd7dc66c0576 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1568 microversion: 2.1 time: 0.192988 Aug 26 06:26:21.761976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 554/1115] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:21 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:21.768886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-872647a3-c57b-469f-94a3-b92834b28908 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:21.769674 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-872647a3-c57b-469f-94a3-b92834b28908 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:21.776722 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-872647a3-c57b-469f-94a3-b92834b28908 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:21.777237 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-872647a3-c57b-469f-94a3-b92834b28908 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:21.777715 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-872647a3-c57b-469f-94a3-b92834b28908 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:21.779180 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-872647a3-c57b-469f-94a3-b92834b28908 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:21.779799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-872647a3-c57b-469f-94a3-b92834b28908 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:21.780320 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-872647a3-c57b-469f-94a3-b92834b28908 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:21.785502 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=100 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:21.815426 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-872647a3-c57b-469f-94a3-b92834b28908 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121343) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 06:26:22.502818 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-872647a3-c57b-469f-94a3-b92834b28908 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "POST /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0/action" status: 202 len: 0 microversion: 2.1 time: 0.737866 Aug 26 06:26:22.504426 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 562/1116] 10.222.0.40 () {60 vars in 1278 bytes} [Fri Aug 26 06:26:21 2022] POST /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:26:22.510844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3dbb63df-f975-4709-aa0a-6456c5570fc4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:22.511624 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3dbb63df-f975-4709-aa0a-6456c5570fc4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:22.513614 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6f5fdd01-06e2-407e-963c-4e6203b5c1b1 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:22.514709 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6f5fdd01-06e2-407e-963c-4e6203b5c1b1 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:22.520932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dbb63df-f975-4709-aa0a-6456c5570fc4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:22.521417 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dbb63df-f975-4709-aa0a-6456c5570fc4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:22.522693 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dbb63df-f975-4709-aa0a-6456c5570fc4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:22.523317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f5fdd01-06e2-407e-963c-4e6203b5c1b1 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:22.523942 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dbb63df-f975-4709-aa0a-6456c5570fc4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:22.524147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f5fdd01-06e2-407e-963c-4e6203b5c1b1 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:22.524545 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dbb63df-f975-4709-aa0a-6456c5570fc4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:22.524719 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f5fdd01-06e2-407e-963c-4e6203b5c1b1 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:22.525101 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3dbb63df-f975-4709-aa0a-6456c5570fc4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:22.525692 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f5fdd01-06e2-407e-963c-4e6203b5c1b1 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:22.526314 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f5fdd01-06e2-407e-963c-4e6203b5c1b1 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:22.526857 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f5fdd01-06e2-407e-963c-4e6203b5c1b1 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:22.709773 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6f5fdd01-06e2-407e-963c-4e6203b5c1b1 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:22.725833 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6f5fdd01-06e2-407e-963c-4e6203b5c1b1 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1516 microversion: 2.1 time: 0.217132 Aug 26 06:26:22.726732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 563/1117] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:22 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1516 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:22.834267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-3dbb63df-f975-4709-aa0a-6456c5570fc4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:22.844707 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3dbb63df-f975-4709-aa0a-6456c5570fc4 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.342401 Aug 26 06:26:22.845630 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 555/1118] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:22 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:23.749288 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3c83d742-f96b-410e-b920-a79d7b8cfa9f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:23.749922 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3c83d742-f96b-410e-b920-a79d7b8cfa9f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:23.757592 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c83d742-f96b-410e-b920-a79d7b8cfa9f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:23.758087 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c83d742-f96b-410e-b920-a79d7b8cfa9f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:23.758522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c83d742-f96b-410e-b920-a79d7b8cfa9f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:23.759256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c83d742-f96b-410e-b920-a79d7b8cfa9f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:23.759713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c83d742-f96b-410e-b920-a79d7b8cfa9f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:23.760312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3c83d742-f96b-410e-b920-a79d7b8cfa9f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:23.865926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f921dcd8-b1a6-48fe-afc5-acf1bd860a95 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:23.872668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f921dcd8-b1a6-48fe-afc5-acf1bd860a95 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:23.876926 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f921dcd8-b1a6-48fe-afc5-acf1bd860a95 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:23.877413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f921dcd8-b1a6-48fe-afc5-acf1bd860a95 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:23.878035 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f921dcd8-b1a6-48fe-afc5-acf1bd860a95 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:23.879153 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f921dcd8-b1a6-48fe-afc5-acf1bd860a95 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:23.879675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f921dcd8-b1a6-48fe-afc5-acf1bd860a95 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:23.880095 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f921dcd8-b1a6-48fe-afc5-acf1bd860a95 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:23.923596 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3c83d742-f96b-410e-b920-a79d7b8cfa9f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:23.934357 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3c83d742-f96b-410e-b920-a79d7b8cfa9f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1516 microversion: 2.1 time: 0.189625 Aug 26 06:26:23.939869 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 564/1119] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:23 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:24.163282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f921dcd8-b1a6-48fe-afc5-acf1bd860a95 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:24.172045 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f921dcd8-b1a6-48fe-afc5-acf1bd860a95 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.310255 Aug 26 06:26:24.172992 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 556/1120] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:23 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:24.968327 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-736d77d6-cbc8-4b09-a089-0d466f80be9b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:24.969215 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-736d77d6-cbc8-4b09-a089-0d466f80be9b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:24.979758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-736d77d6-cbc8-4b09-a089-0d466f80be9b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:24.980544 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-736d77d6-cbc8-4b09-a089-0d466f80be9b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:24.981310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-736d77d6-cbc8-4b09-a089-0d466f80be9b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:24.982322 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-736d77d6-cbc8-4b09-a089-0d466f80be9b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:24.982850 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-736d77d6-cbc8-4b09-a089-0d466f80be9b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:24.983453 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-736d77d6-cbc8-4b09-a089-0d466f80be9b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:25.198349 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-62ec14fb-7f9c-416e-90e9-fc54bc603f27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:25.199716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-62ec14fb-7f9c-416e-90e9-fc54bc603f27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:25.218416 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-62ec14fb-7f9c-416e-90e9-fc54bc603f27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:25.234886 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-62ec14fb-7f9c-416e-90e9-fc54bc603f27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:25.234886 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-62ec14fb-7f9c-416e-90e9-fc54bc603f27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:25.234886 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-62ec14fb-7f9c-416e-90e9-fc54bc603f27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:25.234886 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-62ec14fb-7f9c-416e-90e9-fc54bc603f27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:25.235553 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-62ec14fb-7f9c-416e-90e9-fc54bc603f27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:25.490346 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-62ec14fb-7f9c-416e-90e9-fc54bc603f27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:25.511002 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-62ec14fb-7f9c-416e-90e9-fc54bc603f27 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.318372 Aug 26 06:26:25.519875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 557/1121] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:25 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:25.646313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-586bb8bc-146e-4b5f-a644-12a008f70adc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: .version_select at 0x7f2f08e755e0>, body: {"keypair": {"name": "tempest-keypair-1730155146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZIeK7ualfUN1DrnkyRZ6fLc8cAT37WmgpmK93Qx9GYEXnirmxEoYEj2se0kBF16eL6epHfNWq+cQyXwVfAzESJm5dooF1VpcnTWMySz4026KaH05vmQzxil6bcY2ICVw=="}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:25.667433 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-586bb8bc-146e-4b5f-a644-12a008f70adc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for project c070cba92de641518c86248b1e27daea. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:26:25.676477 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-586bb8bc-146e-4b5f-a644-12a008f70adc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for user 38f279301f8c4c76945d361f19b686ac and project c070cba92de641518c86248b1e27daea. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:26:25.767293 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-736d77d6-cbc8-4b09-a089-0d466f80be9b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:25.772324 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-736d77d6-cbc8-4b09-a089-0d466f80be9b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1518 microversion: 2.1 time: 0.816592 Aug 26 06:26:25.773435 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 565/1122] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:24 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1518 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:25.783159 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-b2eb7244-300a-411a-b1ec-c5ed55e4870c req-f10ed42e-61d5-45e1-b438-6accfd0759ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e760f027-a590-4387-ab32-7dca29d29335", "name": "network-vif-plugged", "status": "completed", "tag": "ab5e913e-41a3-4c93-830a-f63879ab1522"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:25.794312 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-b2eb7244-300a-411a-b1ec-c5ed55e4870c req-f10ed42e-61d5-45e1-b438-6accfd0759ab service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:25.795003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-b2eb7244-300a-411a-b1ec-c5ed55e4870c req-f10ed42e-61d5-45e1-b438-6accfd0759ab service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:25.795617 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-b2eb7244-300a-411a-b1ec-c5ed55e4870c req-f10ed42e-61d5-45e1-b438-6accfd0759ab service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:25.808343 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-b2eb7244-300a-411a-b1ec-c5ed55e4870c req-f10ed42e-61d5-45e1-b438-6accfd0759ab service nova] Creating event network-vif-plugged:ab5e913e-41a3-4c93-830a-f63879ab1522 for instance e760f027-a590-4387-ab32-7dca29d29335 on hv-cinder-85391 Aug 26 06:26:25.814815 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-b2eb7244-300a-411a-b1ec-c5ed55e4870c req-f10ed42e-61d5-45e1-b438-6accfd0759ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039894 Aug 26 06:26:25.815424 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 566/1123] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:26:25.852460 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-586bb8bc-146e-4b5f-a644-12a008f70adc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.301119 Aug 26 06:26:25.853144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 558/1124] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 06:26:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:26:26.547218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c8c60eec-8f34-4c23-80db-9d2296eebadb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:26.548433 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c8c60eec-8f34-4c23-80db-9d2296eebadb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:26.560196 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8c60eec-8f34-4c23-80db-9d2296eebadb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:26.561272 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8c60eec-8f34-4c23-80db-9d2296eebadb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:26.562056 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8c60eec-8f34-4c23-80db-9d2296eebadb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:26.563325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8c60eec-8f34-4c23-80db-9d2296eebadb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:26.564147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8c60eec-8f34-4c23-80db-9d2296eebadb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:26.564922 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c8c60eec-8f34-4c23-80db-9d2296eebadb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:26.724368 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c8c60eec-8f34-4c23-80db-9d2296eebadb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:26.733717 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c8c60eec-8f34-4c23-80db-9d2296eebadb tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.192618 Aug 26 06:26:26.734496 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 567/1125] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:26 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:26.797668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d1be579a-e8d0-4e6a-ba1a-c0659f29b262 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:26.798298 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d1be579a-e8d0-4e6a-ba1a-c0659f29b262 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:26.807220 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1be579a-e8d0-4e6a-ba1a-c0659f29b262 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:26.808003 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1be579a-e8d0-4e6a-ba1a-c0659f29b262 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:26.808600 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1be579a-e8d0-4e6a-ba1a-c0659f29b262 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:26.810025 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1be579a-e8d0-4e6a-ba1a-c0659f29b262 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:26.811071 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1be579a-e8d0-4e6a-ba1a-c0659f29b262 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:26.812523 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1be579a-e8d0-4e6a-ba1a-c0659f29b262 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:27.055856 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d1be579a-e8d0-4e6a-ba1a-c0659f29b262 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:27.063912 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d1be579a-e8d0-4e6a-ba1a-c0659f29b262 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.272108 Aug 26 06:26:27.064487 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 559/1126] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:26 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:27.756567 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4850b5a3-9cab-4a79-8b05-6e4823befefa tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:27.757809 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4850b5a3-9cab-4a79-8b05-6e4823befefa tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:27.767519 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4850b5a3-9cab-4a79-8b05-6e4823befefa tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:27.768116 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4850b5a3-9cab-4a79-8b05-6e4823befefa tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:27.768653 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4850b5a3-9cab-4a79-8b05-6e4823befefa tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:27.769711 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4850b5a3-9cab-4a79-8b05-6e4823befefa tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:27.770465 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4850b5a3-9cab-4a79-8b05-6e4823befefa tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:27.771030 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4850b5a3-9cab-4a79-8b05-6e4823befefa tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:28.100689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5b5c5df8-89c5-4a5b-b35f-2f53a0f3d882 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:28.106709 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5b5c5df8-89c5-4a5b-b35f-2f53a0f3d882 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:28.114816 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5b5c5df8-89c5-4a5b-b35f-2f53a0f3d882 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:28.115679 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5b5c5df8-89c5-4a5b-b35f-2f53a0f3d882 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:28.116421 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5b5c5df8-89c5-4a5b-b35f-2f53a0f3d882 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:28.117434 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5b5c5df8-89c5-4a5b-b35f-2f53a0f3d882 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:28.117964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5b5c5df8-89c5-4a5b-b35f-2f53a0f3d882 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:28.118406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5b5c5df8-89c5-4a5b-b35f-2f53a0f3d882 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:28.189286 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4850b5a3-9cab-4a79-8b05-6e4823befefa tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:28.210427 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4850b5a3-9cab-4a79-8b05-6e4823befefa tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1267 microversion: 2.1 time: 0.458596 Aug 26 06:26:28.221141 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 568/1127] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:27 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1267 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:28.362039 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5b5c5df8-89c5-4a5b-b35f-2f53a0f3d882 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:28.371158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5b5c5df8-89c5-4a5b-b35f-2f53a0f3d882 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.278595 Aug 26 06:26:28.372285 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 560/1128] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:28 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:29.238923 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-fd69b709-d0d5-496d-aeff-4f3bb59ea078 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:29.239688 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-fd69b709-d0d5-496d-aeff-4f3bb59ea078 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:29.248824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd69b709-d0d5-496d-aeff-4f3bb59ea078 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:29.249593 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd69b709-d0d5-496d-aeff-4f3bb59ea078 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:29.251165 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd69b709-d0d5-496d-aeff-4f3bb59ea078 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:29.251165 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd69b709-d0d5-496d-aeff-4f3bb59ea078 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:29.256070 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd69b709-d0d5-496d-aeff-4f3bb59ea078 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:29.256070 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fd69b709-d0d5-496d-aeff-4f3bb59ea078 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:29.393493 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fc95e30a-1898-4bfd-8fe0-9a1ae65d2862 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:29.394122 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fc95e30a-1898-4bfd-8fe0-9a1ae65d2862 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:29.401949 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc95e30a-1898-4bfd-8fe0-9a1ae65d2862 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:29.404006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc95e30a-1898-4bfd-8fe0-9a1ae65d2862 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:29.405024 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc95e30a-1898-4bfd-8fe0-9a1ae65d2862 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:29.405904 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc95e30a-1898-4bfd-8fe0-9a1ae65d2862 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:29.406555 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc95e30a-1898-4bfd-8fe0-9a1ae65d2862 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:29.407181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fc95e30a-1898-4bfd-8fe0-9a1ae65d2862 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:29.477817 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fd69b709-d0d5-496d-aeff-4f3bb59ea078 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:29.486898 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-fd69b709-d0d5-496d-aeff-4f3bb59ea078 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1453 microversion: 2.1 time: 0.254024 Aug 26 06:26:29.487749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 569/1129] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:29 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1453 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:29.515822 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d1388d05-ac16-452e-a2b6-1d26c931b261 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:29.517392 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d1388d05-ac16-452e-a2b6-1d26c931b261 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:29.525815 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1388d05-ac16-452e-a2b6-1d26c931b261 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:29.526802 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1388d05-ac16-452e-a2b6-1d26c931b261 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:29.527901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1388d05-ac16-452e-a2b6-1d26c931b261 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:29.529301 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1388d05-ac16-452e-a2b6-1d26c931b261 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:29.530125 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1388d05-ac16-452e-a2b6-1d26c931b261 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:29.530583 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d1388d05-ac16-452e-a2b6-1d26c931b261 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:29.627159 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-fc95e30a-1898-4bfd-8fe0-9a1ae65d2862 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:29.636301 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fc95e30a-1898-4bfd-8fe0-9a1ae65d2862 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.246793 Aug 26 06:26:29.638916 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 561/1130] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:29 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:29.727258 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d1388d05-ac16-452e-a2b6-1d26c931b261 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:29.735659 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d1388d05-ac16-452e-a2b6-1d26c931b261 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1453 microversion: 2.1 time: 0.226027 Aug 26 06:26:29.736241 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 570/1131] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:29 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1453 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:29.909970 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1145925201", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e056da4a-201b-49f0-b8fe-7e84ff97ec06"}], "security_groups": [{"name": "tempest-securitygroup--1766731682"}], "key_name": "tempest-keypair-1730155146", "user_data": "}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:30.033015 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] validate_networks() for [('e056da4a-201b-49f0-b8fe-7e84ff97ec06', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:26:30.657354 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:26:30.657947 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:26:30.658346 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:26:30.658494 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cd7799fc-eb38-4340-af44-b6b1b94bbc0f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:30.659049 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-cd7799fc-eb38-4340-af44-b6b1b94bbc0f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:30.659677 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:26:30.660173 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:26:30.666047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd7799fc-eb38-4340-af44-b6b1b94bbc0f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:30.666536 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd7799fc-eb38-4340-af44-b6b1b94bbc0f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:30.667024 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd7799fc-eb38-4340-af44-b6b1b94bbc0f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:30.667911 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd7799fc-eb38-4340-af44-b6b1b94bbc0f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:30.668359 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd7799fc-eb38-4340-af44-b6b1b94bbc0f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:30.669151 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cd7799fc-eb38-4340-af44-b6b1b94bbc0f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:30.669829 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:30.670392 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:30.670941 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:30.671903 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:30.672695 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:30.673317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:30.703089 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for project c070cba92de641518c86248b1e27daea. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:26:30.707768 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for user 38f279301f8c4c76945d361f19b686ac and project c070cba92de641518c86248b1e27daea. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:26:30.718945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:30.721885 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:26:30.724275 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:26:30.831733 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cd7799fc-eb38-4340-af44-b6b1b94bbc0f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:30.840120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cd7799fc-eb38-4340-af44-b6b1b94bbc0f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.185405 Aug 26 06:26:30.841430 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 571/1132] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:30 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:30.943464 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [1eca4aa0-64b2-4918-9b75-d36394d6a3c5] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 26 06:26:31.863660 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-496c6ea4-27c2-454c-bd2d-073053a67cd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:31.864239 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-496c6ea4-27c2-454c-bd2d-073053a67cd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:31.866255 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:31.871099 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496c6ea4-27c2-454c-bd2d-073053a67cd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:31.872096 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496c6ea4-27c2-454c-bd2d-073053a67cd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:31.872579 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496c6ea4-27c2-454c-bd2d-073053a67cd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:31.873428 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496c6ea4-27c2-454c-bd2d-073053a67cd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:31.873889 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496c6ea4-27c2-454c-bd2d-073053a67cd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:31.874297 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-496c6ea4-27c2-454c-bd2d-073053a67cd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:31.955402 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [1eca4aa0-64b2-4918-9b75-d36394d6a3c5] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 37364. Aug 26 06:26:31.961123 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6ab3b29a-9756-491a-bf01-48ad0d3bf9a1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.055428 Aug 26 06:26:31.962772 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 562/1133] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:26:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 2058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 06:26:31.975385 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c1152fd6-3bf5-4a3c-a3d6-92acdc17af43 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:31.976006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c1152fd6-3bf5-4a3c-a3d6-92acdc17af43 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:32.158273 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c1152fd6-3bf5-4a3c-a3d6-92acdc17af43 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:32.158273 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c1152fd6-3bf5-4a3c-a3d6-92acdc17af43 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1242 microversion: 2.1 time: 0.120208 Aug 26 06:26:32.158588 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-496c6ea4-27c2-454c-bd2d-073053a67cd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:32.158745 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 563/1134] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:31 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1242 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:32.158849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-496c6ea4-27c2-454c-bd2d-073053a67cd0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.247855 Aug 26 06:26:32.158849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 572/1135] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:31 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:32.849454 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-0d59300a-95d5-41e2-bd18-866c75667841 req-164fe7be-f28c-48a8-8130-a09edc08152f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e760f027-a590-4387-ab32-7dca29d29335", "tag": "ab5e913e-41a3-4c93-830a-f63879ab1522"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:32.861723 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-0d59300a-95d5-41e2-bd18-866c75667841 req-164fe7be-f28c-48a8-8130-a09edc08152f service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:32.867111 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-0d59300a-95d5-41e2-bd18-866c75667841 req-164fe7be-f28c-48a8-8130-a09edc08152f service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:32.867111 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-0d59300a-95d5-41e2-bd18-866c75667841 req-164fe7be-f28c-48a8-8130-a09edc08152f service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:32.875987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-0d59300a-95d5-41e2-bd18-866c75667841 req-164fe7be-f28c-48a8-8130-a09edc08152f service nova] Creating event network-changed:ab5e913e-41a3-4c93-830a-f63879ab1522 for instance e760f027-a590-4387-ab32-7dca29d29335 on hv-cinder-85391 Aug 26 06:26:32.881084 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-0d59300a-95d5-41e2-bd18-866c75667841 req-164fe7be-f28c-48a8-8130-a09edc08152f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035686 Aug 26 06:26:32.881918 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 564/1136] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:26:33.113634 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cc59f6e6-4c0b-49d0-94e3-c061e118e552 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:33.115284 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-cc59f6e6-4c0b-49d0-94e3-c061e118e552 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:33.143095 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0525d223-96c5-48a5-b58d-c8659c60d615 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:33.144596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0525d223-96c5-48a5-b58d-c8659c60d615 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:33.151690 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0525d223-96c5-48a5-b58d-c8659c60d615 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:33.152437 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0525d223-96c5-48a5-b58d-c8659c60d615 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:33.153146 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0525d223-96c5-48a5-b58d-c8659c60d615 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:33.154521 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0525d223-96c5-48a5-b58d-c8659c60d615 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:33.155170 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0525d223-96c5-48a5-b58d-c8659c60d615 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:33.155742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0525d223-96c5-48a5-b58d-c8659c60d615 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:33.208500 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cc59f6e6-4c0b-49d0-94e3-c061e118e552 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:33.216369 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cc59f6e6-4c0b-49d0-94e3-c061e118e552 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1242 microversion: 2.1 time: 0.106551 Aug 26 06:26:33.217192 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 573/1137] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:33 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:33.309507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0525d223-96c5-48a5-b58d-c8659c60d615 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:33.319355 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0525d223-96c5-48a5-b58d-c8659c60d615 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.181535 Aug 26 06:26:33.332992 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 565/1138] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:33 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:34.238354 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4bcc16c6-02d2-451e-bebc-b9067d96cbdb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:34.238985 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4bcc16c6-02d2-451e-bebc-b9067d96cbdb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:34.255796 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4bcc16c6-02d2-451e-bebc-b9067d96cbdb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:34.256290 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4bcc16c6-02d2-451e-bebc-b9067d96cbdb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:34.256722 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4bcc16c6-02d2-451e-bebc-b9067d96cbdb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:34.257421 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4bcc16c6-02d2-451e-bebc-b9067d96cbdb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:34.257867 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4bcc16c6-02d2-451e-bebc-b9067d96cbdb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:34.258284 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4bcc16c6-02d2-451e-bebc-b9067d96cbdb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:34.331512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4bcc16c6-02d2-451e-bebc-b9067d96cbdb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:34.340030 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4bcc16c6-02d2-451e-bebc-b9067d96cbdb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1246 microversion: 2.1 time: 0.105257 Aug 26 06:26:34.342728 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 574/1139] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:34 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1246 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:34.345324 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-89c8f2df-e9b5-4ddb-b365-90e94fab53d8 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:34.348415 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-89c8f2df-e9b5-4ddb-b365-90e94fab53d8 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:34.352774 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89c8f2df-e9b5-4ddb-b365-90e94fab53d8 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:34.353260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89c8f2df-e9b5-4ddb-b365-90e94fab53d8 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:34.353741 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89c8f2df-e9b5-4ddb-b365-90e94fab53d8 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:34.355110 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89c8f2df-e9b5-4ddb-b365-90e94fab53d8 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:34.355110 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89c8f2df-e9b5-4ddb-b365-90e94fab53d8 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:34.356091 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-89c8f2df-e9b5-4ddb-b365-90e94fab53d8 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:34.505915 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-89c8f2df-e9b5-4ddb-b365-90e94fab53d8 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:34.514570 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-89c8f2df-e9b5-4ddb-b365-90e94fab53d8 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.173796 Aug 26 06:26:34.515178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 566/1140] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:34 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:26:35.365545 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e826fb14-2408-49d5-afc2-77d0c6b76202 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:35.366250 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e826fb14-2408-49d5-afc2-77d0c6b76202 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:35.374860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e826fb14-2408-49d5-afc2-77d0c6b76202 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:35.375440 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e826fb14-2408-49d5-afc2-77d0c6b76202 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:35.375886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e826fb14-2408-49d5-afc2-77d0c6b76202 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:35.376609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e826fb14-2408-49d5-afc2-77d0c6b76202 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:35.377062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e826fb14-2408-49d5-afc2-77d0c6b76202 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:35.377485 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e826fb14-2408-49d5-afc2-77d0c6b76202 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:35.448161 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e826fb14-2408-49d5-afc2-77d0c6b76202 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:35.456874 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e826fb14-2408-49d5-afc2-77d0c6b76202 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1294 microversion: 2.1 time: 0.095329 Aug 26 06:26:35.457452 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 575/1141] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:35 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:35.535421 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4ea75ea3-bc2e-44c9-930d-1295cc7c13a0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:35.536030 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4ea75ea3-bc2e-44c9-930d-1295cc7c13a0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:35.543560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ea75ea3-bc2e-44c9-930d-1295cc7c13a0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:35.544782 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ea75ea3-bc2e-44c9-930d-1295cc7c13a0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:35.545223 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ea75ea3-bc2e-44c9-930d-1295cc7c13a0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:35.546139 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ea75ea3-bc2e-44c9-930d-1295cc7c13a0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:35.546383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ea75ea3-bc2e-44c9-930d-1295cc7c13a0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:35.546929 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4ea75ea3-bc2e-44c9-930d-1295cc7c13a0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:35.691609 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4ea75ea3-bc2e-44c9-930d-1295cc7c13a0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:35.695232 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=100 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:35.700850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4ea75ea3-bc2e-44c9-930d-1295cc7c13a0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.168347 Aug 26 06:26:35.701640 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 567/1142] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:35 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:36.491504 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c66bc4db-09e4-46b6-937c-d0712859a01f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:36.492472 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c66bc4db-09e4-46b6-937c-d0712859a01f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:36.500658 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66bc4db-09e4-46b6-937c-d0712859a01f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:36.501476 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66bc4db-09e4-46b6-937c-d0712859a01f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:36.501960 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66bc4db-09e4-46b6-937c-d0712859a01f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:36.502764 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66bc4db-09e4-46b6-937c-d0712859a01f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:36.503565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66bc4db-09e4-46b6-937c-d0712859a01f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:36.503861 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c66bc4db-09e4-46b6-937c-d0712859a01f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:36.573117 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c66bc4db-09e4-46b6-937c-d0712859a01f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:36.581984 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c66bc4db-09e4-46b6-937c-d0712859a01f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1312 microversion: 2.1 time: 0.095399 Aug 26 06:26:36.582540 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 576/1143] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:36 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:36.722133 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-df4f42ef-4c1d-4440-8b5b-44321f2b3eae tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:36.722777 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-df4f42ef-4c1d-4440-8b5b-44321f2b3eae tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:36.729613 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df4f42ef-4c1d-4440-8b5b-44321f2b3eae tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:36.730111 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df4f42ef-4c1d-4440-8b5b-44321f2b3eae tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:36.730554 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df4f42ef-4c1d-4440-8b5b-44321f2b3eae tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:36.731745 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df4f42ef-4c1d-4440-8b5b-44321f2b3eae tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:36.731893 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df4f42ef-4c1d-4440-8b5b-44321f2b3eae tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:36.732539 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df4f42ef-4c1d-4440-8b5b-44321f2b3eae tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:36.900296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-df4f42ef-4c1d-4440-8b5b-44321f2b3eae tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:36.909934 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-df4f42ef-4c1d-4440-8b5b-44321f2b3eae tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.191842 Aug 26 06:26:36.910870 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 568/1144] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:36 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:37.604934 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0a0ad7a2-266f-471c-a25c-63c8983f5d07 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:37.607078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0a0ad7a2-266f-471c-a25c-63c8983f5d07 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:37.614434 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a0ad7a2-266f-471c-a25c-63c8983f5d07 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:37.615056 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a0ad7a2-266f-471c-a25c-63c8983f5d07 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:37.615594 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a0ad7a2-266f-471c-a25c-63c8983f5d07 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:37.616407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a0ad7a2-266f-471c-a25c-63c8983f5d07 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:37.616966 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a0ad7a2-266f-471c-a25c-63c8983f5d07 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:37.617487 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0a0ad7a2-266f-471c-a25c-63c8983f5d07 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:37.847782 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0a0ad7a2-266f-471c-a25c-63c8983f5d07 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:37.856593 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0a0ad7a2-266f-471c-a25c-63c8983f5d07 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1368 microversion: 2.1 time: 0.255559 Aug 26 06:26:37.857187 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 577/1145] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:37 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:37.932634 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-90f57a37-228b-42da-a766-15d3e690f32b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:37.933268 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-90f57a37-228b-42da-a766-15d3e690f32b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:37.944800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90f57a37-228b-42da-a766-15d3e690f32b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:37.945611 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90f57a37-228b-42da-a766-15d3e690f32b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:37.946048 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90f57a37-228b-42da-a766-15d3e690f32b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:37.946995 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90f57a37-228b-42da-a766-15d3e690f32b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:37.947452 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90f57a37-228b-42da-a766-15d3e690f32b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:37.947882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-90f57a37-228b-42da-a766-15d3e690f32b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:38.101364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-90f57a37-228b-42da-a766-15d3e690f32b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:38.109965 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-90f57a37-228b-42da-a766-15d3e690f32b tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.181831 Aug 26 06:26:38.110542 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 569/1146] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:37 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:38.384592 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-b6b50cd8-c1f9-4c55-94de-78d8757a26d3 req-b8ec97b2-dbba-4681-8093-ba8471169664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae98859-f32e-4f5b-b796-a330a860f02a", "tag": "dc8f2e1e-4654-4a97-af55-30d11a6929e3"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:38.395981 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-b6b50cd8-c1f9-4c55-94de-78d8757a26d3 req-b8ec97b2-dbba-4681-8093-ba8471169664 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:38.396451 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-b6b50cd8-c1f9-4c55-94de-78d8757a26d3 req-b8ec97b2-dbba-4681-8093-ba8471169664 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:38.396871 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-b6b50cd8-c1f9-4c55-94de-78d8757a26d3 req-b8ec97b2-dbba-4681-8093-ba8471169664 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:38.410609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-b6b50cd8-c1f9-4c55-94de-78d8757a26d3 req-b8ec97b2-dbba-4681-8093-ba8471169664 service nova] Creating event network-changed:dc8f2e1e-4654-4a97-af55-30d11a6929e3 for instance 9ae98859-f32e-4f5b-b796-a330a860f02a on hv-cinder-85391 Aug 26 06:26:38.415777 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-b6b50cd8-c1f9-4c55-94de-78d8757a26d3 req-b8ec97b2-dbba-4681-8093-ba8471169664 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035691 Aug 26 06:26:38.416395 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 578/1147] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:26:38.879166 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-805cef67-2f6c-4093-b38d-3932c8321279 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:38.879932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-805cef67-2f6c-4093-b38d-3932c8321279 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:38.886169 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-805cef67-2f6c-4093-b38d-3932c8321279 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:38.886691 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-805cef67-2f6c-4093-b38d-3932c8321279 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:38.887654 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-805cef67-2f6c-4093-b38d-3932c8321279 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:38.888369 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-805cef67-2f6c-4093-b38d-3932c8321279 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:38.888830 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-805cef67-2f6c-4093-b38d-3932c8321279 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:38.889260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-805cef67-2f6c-4093-b38d-3932c8321279 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:39.029100 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-805cef67-2f6c-4093-b38d-3932c8321279 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:39.037222 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-805cef67-2f6c-4093-b38d-3932c8321279 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1368 microversion: 2.1 time: 0.163497 Aug 26 06:26:39.037892 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 570/1148] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:38 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:39.132685 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-7c41fa99-a43c-4bad-a4ee-d09a652ae2a5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:39.133377 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-7c41fa99-a43c-4bad-a4ee-d09a652ae2a5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:39.140876 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c41fa99-a43c-4bad-a4ee-d09a652ae2a5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:39.141356 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c41fa99-a43c-4bad-a4ee-d09a652ae2a5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:39.141800 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c41fa99-a43c-4bad-a4ee-d09a652ae2a5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:39.142499 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c41fa99-a43c-4bad-a4ee-d09a652ae2a5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:39.142973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c41fa99-a43c-4bad-a4ee-d09a652ae2a5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:39.143399 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-7c41fa99-a43c-4bad-a4ee-d09a652ae2a5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:39.283246 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-7c41fa99-a43c-4bad-a4ee-d09a652ae2a5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:39.292090 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-7c41fa99-a43c-4bad-a4ee-d09a652ae2a5 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.163653 Aug 26 06:26:39.297683 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 579/1149] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:39 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:39.409471 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-14fa8da9-d1b3-4ea1-870b-865d70d01d37 req-6430b8a6-0893-4312-b73b-a3da45251691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4228acc2-99a7-47c3-9cef-92c0f7bcb7b0", "name": "network-vif-plugged", "status": "completed", "tag": "16e251e3-f929-404a-95a5-e7b555e4782f"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:39.419831 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-14fa8da9-d1b3-4ea1-870b-865d70d01d37 req-6430b8a6-0893-4312-b73b-a3da45251691 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:39.420317 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-14fa8da9-d1b3-4ea1-870b-865d70d01d37 req-6430b8a6-0893-4312-b73b-a3da45251691 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:39.420743 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-14fa8da9-d1b3-4ea1-870b-865d70d01d37 req-6430b8a6-0893-4312-b73b-a3da45251691 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:39.432863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-14fa8da9-d1b3-4ea1-870b-865d70d01d37 req-6430b8a6-0893-4312-b73b-a3da45251691 service nova] Creating event network-vif-plugged:16e251e3-f929-404a-95a5-e7b555e4782f for instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 on hv-cinder-85391 Aug 26 06:26:39.438038 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-14fa8da9-d1b3-4ea1-870b-865d70d01d37 req-6430b8a6-0893-4312-b73b-a3da45251691 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032385 Aug 26 06:26:39.438638 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 571/1150] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:26:40.059734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-fb17e504-79ca-41fd-b46d-6db6f2740d6c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:40.060593 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-fb17e504-79ca-41fd-b46d-6db6f2740d6c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:40.066936 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb17e504-79ca-41fd-b46d-6db6f2740d6c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:40.067457 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb17e504-79ca-41fd-b46d-6db6f2740d6c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:40.067868 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb17e504-79ca-41fd-b46d-6db6f2740d6c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:40.068571 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb17e504-79ca-41fd-b46d-6db6f2740d6c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:40.069029 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb17e504-79ca-41fd-b46d-6db6f2740d6c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:40.070038 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-fb17e504-79ca-41fd-b46d-6db6f2740d6c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:40.073117 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:40.221753 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-fb17e504-79ca-41fd-b46d-6db6f2740d6c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:40.231995 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-fb17e504-79ca-41fd-b46d-6db6f2740d6c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1368 microversion: 2.1 time: 0.177532 Aug 26 06:26:40.232673 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 580/1151] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:40 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:40.316163 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7f8d5be9-e154-41c5-8b40-ffb93939daf0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:40.317083 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7f8d5be9-e154-41c5-8b40-ffb93939daf0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:40.323302 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f8d5be9-e154-41c5-8b40-ffb93939daf0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:40.323783 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f8d5be9-e154-41c5-8b40-ffb93939daf0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:40.324213 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f8d5be9-e154-41c5-8b40-ffb93939daf0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:40.325080 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f8d5be9-e154-41c5-8b40-ffb93939daf0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:40.325744 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f8d5be9-e154-41c5-8b40-ffb93939daf0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:40.326173 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f8d5be9-e154-41c5-8b40-ffb93939daf0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:40.692052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:40.748580 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-7f8d5be9-e154-41c5-8b40-ffb93939daf0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:40.756530 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7f8d5be9-e154-41c5-8b40-ffb93939daf0 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.445366 Aug 26 06:26:40.757099 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 572/1152] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:40 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:41.254530 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-52b88b3b-539c-47e3-8601-0416f117c235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:41.255493 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-52b88b3b-539c-47e3-8601-0416f117c235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:41.263733 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52b88b3b-539c-47e3-8601-0416f117c235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:41.264104 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52b88b3b-539c-47e3-8601-0416f117c235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:41.264537 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52b88b3b-539c-47e3-8601-0416f117c235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:41.265229 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52b88b3b-539c-47e3-8601-0416f117c235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:41.265713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52b88b3b-539c-47e3-8601-0416f117c235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:41.266079 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-52b88b3b-539c-47e3-8601-0416f117c235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:41.409267 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-52b88b3b-539c-47e3-8601-0416f117c235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:41.417046 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-52b88b3b-539c-47e3-8601-0416f117c235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1368 microversion: 2.1 time: 0.167064 Aug 26 06:26:41.417605 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 581/1153] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:41 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:41.777894 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1dca8f18-fcad-4c55-a872-2288ab8fe848 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:41.778671 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1dca8f18-fcad-4c55-a872-2288ab8fe848 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:41.785433 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1dca8f18-fcad-4c55-a872-2288ab8fe848 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:41.785908 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1dca8f18-fcad-4c55-a872-2288ab8fe848 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:41.786339 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1dca8f18-fcad-4c55-a872-2288ab8fe848 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:41.787095 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1dca8f18-fcad-4c55-a872-2288ab8fe848 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:41.787564 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1dca8f18-fcad-4c55-a872-2288ab8fe848 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:41.787969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1dca8f18-fcad-4c55-a872-2288ab8fe848 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:41.932304 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-1dca8f18-fcad-4c55-a872-2288ab8fe848 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:41.941085 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1dca8f18-fcad-4c55-a872-2288ab8fe848 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1574 microversion: 2.1 time: 0.167638 Aug 26 06:26:41.941682 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 573/1154] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:41 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:42.438010 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-466736ee-d812-4100-8c3a-bc53d906645a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:42.438663 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-466736ee-d812-4100-8c3a-bc53d906645a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:42.445074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-466736ee-d812-4100-8c3a-bc53d906645a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:42.445547 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-466736ee-d812-4100-8c3a-bc53d906645a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:42.445975 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-466736ee-d812-4100-8c3a-bc53d906645a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:42.446684 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-466736ee-d812-4100-8c3a-bc53d906645a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:42.447133 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-466736ee-d812-4100-8c3a-bc53d906645a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:42.447551 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-466736ee-d812-4100-8c3a-bc53d906645a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:42.840966 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-466736ee-d812-4100-8c3a-bc53d906645a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:42.848820 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-466736ee-d812-4100-8c3a-bc53d906645a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1368 microversion: 2.1 time: 0.414914 Aug 26 06:26:42.849347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 582/1155] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:42 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1368 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:42.962102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-333a93e2-b842-4ef9-afaf-fc1b2e053e8c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:42.962784 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-333a93e2-b842-4ef9-afaf-fc1b2e053e8c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:42.964722 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=12 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:42.970203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-333a93e2-b842-4ef9-afaf-fc1b2e053e8c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:42.970723 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-333a93e2-b842-4ef9-afaf-fc1b2e053e8c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:42.971175 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-333a93e2-b842-4ef9-afaf-fc1b2e053e8c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:42.971844 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-333a93e2-b842-4ef9-afaf-fc1b2e053e8c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:42.972290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-333a93e2-b842-4ef9-afaf-fc1b2e053e8c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:42.972728 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-333a93e2-b842-4ef9-afaf-fc1b2e053e8c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:43.180097 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-333a93e2-b842-4ef9-afaf-fc1b2e053e8c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:43.180097 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-333a93e2-b842-4ef9-afaf-fc1b2e053e8c tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1561 microversion: 2.1 time: 0.162908 Aug 26 06:26:43.180097 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 574/1156] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:42 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:43.869937 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-99769275-1691-4e47-a308-6241b794f236 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:43.870543 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-99769275-1691-4e47-a308-6241b794f236 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:43.872813 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:26:43.880601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-99769275-1691-4e47-a308-6241b794f236 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:43.881100 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-99769275-1691-4e47-a308-6241b794f236 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:43.881546 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-99769275-1691-4e47-a308-6241b794f236 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:43.882306 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-99769275-1691-4e47-a308-6241b794f236 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:43.882805 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-99769275-1691-4e47-a308-6241b794f236 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:43.883429 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-99769275-1691-4e47-a308-6241b794f236 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:44.035130 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-99769275-1691-4e47-a308-6241b794f236 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:44.045157 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-99769275-1691-4e47-a308-6241b794f236 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1368 microversion: 2.1 time: 0.178231 Aug 26 06:26:44.045812 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 583/1157] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:43 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:45.075841 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-b3955211-5c8b-4697-a43e-d99f124f4f44 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:45.076427 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-b3955211-5c8b-4697-a43e-d99f124f4f44 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:45.083122 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b3955211-5c8b-4697-a43e-d99f124f4f44 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:45.083607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b3955211-5c8b-4697-a43e-d99f124f4f44 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:45.084042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b3955211-5c8b-4697-a43e-d99f124f4f44 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:45.084737 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b3955211-5c8b-4697-a43e-d99f124f4f44 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:45.085188 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b3955211-5c8b-4697-a43e-d99f124f4f44 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:45.085619 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-b3955211-5c8b-4697-a43e-d99f124f4f44 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:45.221407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-b3955211-5c8b-4697-a43e-d99f124f4f44 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:45.231507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-b3955211-5c8b-4697-a43e-d99f124f4f44 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1368 microversion: 2.1 time: 0.159288 Aug 26 06:26:45.232263 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 575/1158] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:45 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:45.577396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-1fdd1ced-a0fd-4348-89ad-95adaa8c84c2 req-88013e7c-73fd-48ef-82d9-aa7d78309bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae98859-f32e-4f5b-b796-a330a860f02a", "name": "network-vif-plugged", "status": "completed", "tag": "dc8f2e1e-4654-4a97-af55-30d11a6929e3"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:45.587892 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1fdd1ced-a0fd-4348-89ad-95adaa8c84c2 req-88013e7c-73fd-48ef-82d9-aa7d78309bf4 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:45.588362 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1fdd1ced-a0fd-4348-89ad-95adaa8c84c2 req-88013e7c-73fd-48ef-82d9-aa7d78309bf4 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:45.588786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-1fdd1ced-a0fd-4348-89ad-95adaa8c84c2 req-88013e7c-73fd-48ef-82d9-aa7d78309bf4 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:45.600599 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-1fdd1ced-a0fd-4348-89ad-95adaa8c84c2 req-88013e7c-73fd-48ef-82d9-aa7d78309bf4 service nova] Creating event network-vif-plugged:dc8f2e1e-4654-4a97-af55-30d11a6929e3 for instance 9ae98859-f32e-4f5b-b796-a330a860f02a on hv-cinder-85391 Aug 26 06:26:45.605535 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-1fdd1ced-a0fd-4348-89ad-95adaa8c84c2 req-88013e7c-73fd-48ef-82d9-aa7d78309bf4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031941 Aug 26 06:26:45.606939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 584/1159] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:26:46.252551 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4903f21a-9949-4431-b8ca-c1ddc153c295 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:46.253252 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4903f21a-9949-4431-b8ca-c1ddc153c295 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:46.260138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4903f21a-9949-4431-b8ca-c1ddc153c295 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:46.264613 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4903f21a-9949-4431-b8ca-c1ddc153c295 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:46.264613 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4903f21a-9949-4431-b8ca-c1ddc153c295 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:46.264613 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4903f21a-9949-4431-b8ca-c1ddc153c295 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:46.264613 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4903f21a-9949-4431-b8ca-c1ddc153c295 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:46.264986 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4903f21a-9949-4431-b8ca-c1ddc153c295 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:46.407852 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-4903f21a-9949-4431-b8ca-c1ddc153c295 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:46.417407 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4903f21a-9949-4431-b8ca-c1ddc153c295 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1368 microversion: 2.1 time: 0.168679 Aug 26 06:26:46.417982 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 576/1160] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:46 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:47.440409 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cb84f09c-2e40-4a0f-9f9a-f2de7669557b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:47.441100 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-cb84f09c-2e40-4a0f-9f9a-f2de7669557b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:47.448198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb84f09c-2e40-4a0f-9f9a-f2de7669557b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:47.459910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb84f09c-2e40-4a0f-9f9a-f2de7669557b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:47.459910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb84f09c-2e40-4a0f-9f9a-f2de7669557b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:47.459910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb84f09c-2e40-4a0f-9f9a-f2de7669557b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:47.459910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb84f09c-2e40-4a0f-9f9a-f2de7669557b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:47.460331 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cb84f09c-2e40-4a0f-9f9a-f2de7669557b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:47.588650 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cb84f09c-2e40-4a0f-9f9a-f2de7669557b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:26:47.598153 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cb84f09c-2e40-4a0f-9f9a-f2de7669557b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1558 microversion: 2.1 time: 0.162671 Aug 26 06:26:47.598734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 585/1161] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:26:47 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:26:47.620077 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-aa994326-9e90-425e-a982-7bff417fb42d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:26:47.620642 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-aa994326-9e90-425e-a982-7bff417fb42d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:26:47.627624 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa994326-9e90-425e-a982-7bff417fb42d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:47.628106 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa994326-9e90-425e-a982-7bff417fb42d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:47.628549 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa994326-9e90-425e-a982-7bff417fb42d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:47.629249 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa994326-9e90-425e-a982-7bff417fb42d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:47.629703 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa994326-9e90-425e-a982-7bff417fb42d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:47.630313 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa994326-9e90-425e-a982-7bff417fb42d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:47.714543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-aa994326-9e90-425e-a982-7bff417fb42d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098461 Aug 26 06:26:47.716615 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 577/1162] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 06:26:47 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:26:48.836539 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-bc482e97-1a82-4e3c-9894-2d6a8d78a573 req-6929c098-8d66-4238-a132-6ff62b358ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae98859-f32e-4f5b-b796-a330a860f02a", "tag": "dc8f2e1e-4654-4a97-af55-30d11a6929e3"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:26:48.847420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-bc482e97-1a82-4e3c-9894-2d6a8d78a573 req-6929c098-8d66-4238-a132-6ff62b358ead service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:26:48.847899 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-bc482e97-1a82-4e3c-9894-2d6a8d78a573 req-6929c098-8d66-4238-a132-6ff62b358ead service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:26:48.848333 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-bc482e97-1a82-4e3c-9894-2d6a8d78a573 req-6929c098-8d66-4238-a132-6ff62b358ead service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:26:48.860821 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-bc482e97-1a82-4e3c-9894-2d6a8d78a573 req-6929c098-8d66-4238-a132-6ff62b358ead service nova] Creating event network-changed:dc8f2e1e-4654-4a97-af55-30d11a6929e3 for instance 9ae98859-f32e-4f5b-b796-a330a860f02a on hv-cinder-85391 Aug 26 06:26:48.865811 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-bc482e97-1a82-4e3c-9894-2d6a8d78a573 req-6929c098-8d66-4238-a132-6ff62b358ead service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033109 Aug 26 06:26:48.866592 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 586/1163] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:27:24.930989 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:27:24.931823 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=54 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:27:24.937059 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-3ffd50cb-28a7-439d-9cd0-6a23c8daee57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:24.937548 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-3ffd50cb-28a7-439d-9cd0-6a23c8daee57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:24.943860 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3ffd50cb-28a7-439d-9cd0-6a23c8daee57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:24.944340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3ffd50cb-28a7-439d-9cd0-6a23c8daee57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:24.944782 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3ffd50cb-28a7-439d-9cd0-6a23c8daee57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:24.945663 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3ffd50cb-28a7-439d-9cd0-6a23c8daee57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:24.946118 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3ffd50cb-28a7-439d-9cd0-6a23c8daee57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:24.946539 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-3ffd50cb-28a7-439d-9cd0-6a23c8daee57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:24.974514 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-3ffd50cb-28a7-439d-9cd0-6a23c8daee57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/ips" status: 200 len: 149 microversion: 2.1 time: 0.045228 Aug 26 06:27:24.975150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 578/1164] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 06:27:24 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:27:27.264531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b457e712-f759-4fde-8b1e-ef43da8cdb90 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6578d16b-83fa-4ddd-8eda-55bde34234aa"}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:27:27.268714 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b457e712-f759-4fde-8b1e-ef43da8cdb90 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:27.272993 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=31 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:27:27.274047 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=33 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:27:27.281038 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b457e712-f759-4fde-8b1e-ef43da8cdb90 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:27.281519 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b457e712-f759-4fde-8b1e-ef43da8cdb90 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:27.281944 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b457e712-f759-4fde-8b1e-ef43da8cdb90 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:27.282675 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b457e712-f759-4fde-8b1e-ef43da8cdb90 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:27.283126 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b457e712-f759-4fde-8b1e-ef43da8cdb90 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:27.283548 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b457e712-f759-4fde-8b1e-ef43da8cdb90 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:28.610807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b457e712-f759-4fde-8b1e-ef43da8cdb90 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.352299 Aug 26 06:27:28.612105 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 587/1165] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:27:27 2022] POST /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-volume_attachments => generated 194 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:27:37.284314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-790bf481-a58f-4d9d-a5af-1191c1676a51 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: .version_select at 0x7f2f08e755e0>, body: {"keypair": {"name": "tempest-keypair-2108428117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0g0mYXFxnCBtH0qowFlM5+ZqkWfMgvkzULltq8PkKO8YbqI0qJdrBlzxDPACiBNymNsNgPi1Pg9T5WdPslBffvL0O0xlRoTDAG+mAJiHVwy0bu7u1WrJL7xPRRcoLEcA=="}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:27:37.302065 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-790bf481-a58f-4d9d-a5af-1191c1676a51 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for project c070cba92de641518c86248b1e27daea. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:27:37.306287 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-790bf481-a58f-4d9d-a5af-1191c1676a51 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for user 38f279301f8c4c76945d361f19b686ac and project c070cba92de641518c86248b1e27daea. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:27:37.665168 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-790bf481-a58f-4d9d-a5af-1191c1676a51 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.385561 Aug 26 06:27:37.665775 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 579/1166] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 06:27:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:27:41.677960 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:27:41.679125 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:27:41.684317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2089025961", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e056da4a-201b-49f0-b8fe-7e84ff97ec06"}], "security_groups": [{"name": "tempest-securitygroup--897157137"}], "key_name": "tempest-keypair-2108428117", "user_data": "}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:27:41.799070 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.network.neutron [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] validate_networks() for [('e056da4a-201b-49f0-b8fe-7e84ff97ec06', None, None, None, None, None)] {{(pid=121343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:27:42.248851 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Flavor limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:27:42.249263 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Image limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:27:42.249730 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Flavor pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:27:42.250137 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Image pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:27:42.250537 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:27:42.259718 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:42.260189 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:42.260631 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:42.261467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:42.261919 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:42.262336 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:42.278893 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for project c070cba92de641518c86248b1e27daea. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:27:42.282794 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for user 38f279301f8c4c76945d361f19b686ac and project c070cba92de641518c86248b1e27daea. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:27:42.295953 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Going to run 1 instances... {{(pid=121343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:27:42.299443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:27:42.533700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d976ae32-ad77-4803-bce4-216dc45eb415 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.858629 Aug 26 06:27:42.534326 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 588/1167] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:27:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:27:42.545703 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ff8295e5-4e59-4657-a11d-3616ba9135ca tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:42.548382 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ff8295e5-4e59-4657-a11d-3616ba9135ca tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:42.612647 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ff8295e5-4e59-4657-a11d-3616ba9135ca tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:42.624042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ff8295e5-4e59-4657-a11d-3616ba9135ca tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1242 microversion: 2.1 time: 0.082530 Aug 26 06:27:42.624794 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 580/1168] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:42 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:43.655864 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e34f4ab5-880a-4afe-b2e0-f5814fa75a81 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:43.656705 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e34f4ab5-880a-4afe-b2e0-f5814fa75a81 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:43.725869 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e34f4ab5-880a-4afe-b2e0-f5814fa75a81 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:43.736711 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e34f4ab5-880a-4afe-b2e0-f5814fa75a81 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1242 microversion: 2.1 time: 0.085787 Aug 26 06:27:43.737278 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 589/1169] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:43 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:44.759702 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-70946da2-7c5e-4ecd-9536-beab9298e719 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:44.760355 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-70946da2-7c5e-4ecd-9536-beab9298e719 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:44.770057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70946da2-7c5e-4ecd-9536-beab9298e719 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:44.770543 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70946da2-7c5e-4ecd-9536-beab9298e719 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:44.771014 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70946da2-7c5e-4ecd-9536-beab9298e719 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:44.771754 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70946da2-7c5e-4ecd-9536-beab9298e719 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:44.772214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70946da2-7c5e-4ecd-9536-beab9298e719 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:44.772753 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-70946da2-7c5e-4ecd-9536-beab9298e719 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:44.842158 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-70946da2-7c5e-4ecd-9536-beab9298e719 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:44.850752 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-70946da2-7c5e-4ecd-9536-beab9298e719 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1238 microversion: 2.1 time: 0.094864 Aug 26 06:27:44.851340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 581/1170] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:44 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:45.877288 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ba2dcc74-31ca-43e8-be25-ad6aab6a4a2c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:45.878585 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ba2dcc74-31ca-43e8-be25-ad6aab6a4a2c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:45.888651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba2dcc74-31ca-43e8-be25-ad6aab6a4a2c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:45.889425 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba2dcc74-31ca-43e8-be25-ad6aab6a4a2c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:45.889948 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba2dcc74-31ca-43e8-be25-ad6aab6a4a2c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:45.891083 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba2dcc74-31ca-43e8-be25-ad6aab6a4a2c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:45.891849 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba2dcc74-31ca-43e8-be25-ad6aab6a4a2c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:45.892409 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ba2dcc74-31ca-43e8-be25-ad6aab6a4a2c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:45.991064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ba2dcc74-31ca-43e8-be25-ad6aab6a4a2c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:46.000939 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ba2dcc74-31ca-43e8-be25-ad6aab6a4a2c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1302 microversion: 2.1 time: 0.127661 Aug 26 06:27:46.001528 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 590/1171] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:45 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1302 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:47.030972 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ccedadd4-eabf-4c49-a2ff-e55df16f6def tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:47.031596 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ccedadd4-eabf-4c49-a2ff-e55df16f6def tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:47.038709 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccedadd4-eabf-4c49-a2ff-e55df16f6def tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:47.039200 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccedadd4-eabf-4c49-a2ff-e55df16f6def tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:47.039638 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccedadd4-eabf-4c49-a2ff-e55df16f6def tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:47.040338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccedadd4-eabf-4c49-a2ff-e55df16f6def tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:47.040789 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccedadd4-eabf-4c49-a2ff-e55df16f6def tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:47.041220 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ccedadd4-eabf-4c49-a2ff-e55df16f6def tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:47.193082 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ccedadd4-eabf-4c49-a2ff-e55df16f6def tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:47.205493 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ccedadd4-eabf-4c49-a2ff-e55df16f6def tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1367 microversion: 2.1 time: 0.179780 Aug 26 06:27:47.207122 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 582/1172] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:47 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:48.237416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b7b53957-c7da-4d66-9199-4683a92b6235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:48.238112 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b7b53957-c7da-4d66-9199-4683a92b6235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:48.245310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7b53957-c7da-4d66-9199-4683a92b6235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:48.247074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7b53957-c7da-4d66-9199-4683a92b6235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:48.247074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7b53957-c7da-4d66-9199-4683a92b6235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:48.247074 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7b53957-c7da-4d66-9199-4683a92b6235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:48.247554 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7b53957-c7da-4d66-9199-4683a92b6235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:48.247902 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b7b53957-c7da-4d66-9199-4683a92b6235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:48.416089 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b7b53957-c7da-4d66-9199-4683a92b6235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:48.425668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b7b53957-c7da-4d66-9199-4683a92b6235 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1367 microversion: 2.1 time: 0.192122 Aug 26 06:27:48.426244 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 591/1173] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:48 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:48.595572 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-e1e679a2-70b2-47ef-be9c-e9db6a84a627 req-f079f398-02d4-4444-bcae-d548e8f56cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c20b2603-fcec-4d01-bc64-d8dea988ccfe", "tag": "1fd78a20-ca43-4b3a-8ff2-4f1c64768455"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:27:48.608675 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-e1e679a2-70b2-47ef-be9c-e9db6a84a627 req-f079f398-02d4-4444-bcae-d548e8f56cb5 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:48.609175 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-e1e679a2-70b2-47ef-be9c-e9db6a84a627 req-f079f398-02d4-4444-bcae-d548e8f56cb5 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:48.609645 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-e1e679a2-70b2-47ef-be9c-e9db6a84a627 req-f079f398-02d4-4444-bcae-d548e8f56cb5 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:48.623254 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-e1e679a2-70b2-47ef-be9c-e9db6a84a627 req-f079f398-02d4-4444-bcae-d548e8f56cb5 service nova] Creating event network-changed:1fd78a20-ca43-4b3a-8ff2-4f1c64768455 for instance c20b2603-fcec-4d01-bc64-d8dea988ccfe on hv-cinder-85391 Aug 26 06:27:48.628747 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-e1e679a2-70b2-47ef-be9c-e9db6a84a627 req-f079f398-02d4-4444-bcae-d548e8f56cb5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106914 Aug 26 06:27:48.632168 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 583/1174] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:27:49.449492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4ed4e95c-f20e-42b5-9178-a0580bec4ca8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:49.450138 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4ed4e95c-f20e-42b5-9178-a0580bec4ca8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:49.457756 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ed4e95c-f20e-42b5-9178-a0580bec4ca8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:49.458244 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ed4e95c-f20e-42b5-9178-a0580bec4ca8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:49.458706 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ed4e95c-f20e-42b5-9178-a0580bec4ca8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:49.459421 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ed4e95c-f20e-42b5-9178-a0580bec4ca8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:49.459877 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ed4e95c-f20e-42b5-9178-a0580bec4ca8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:49.460303 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ed4e95c-f20e-42b5-9178-a0580bec4ca8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:49.607336 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4ed4e95c-f20e-42b5-9178-a0580bec4ca8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:49.614258 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4ed4e95c-f20e-42b5-9178-a0580bec4ca8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1367 microversion: 2.1 time: 0.169395 Aug 26 06:27:49.615007 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 592/1175] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:49 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:50.638977 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-78c43e83-40eb-4b33-981a-14971574051b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:50.639671 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-78c43e83-40eb-4b33-981a-14971574051b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:50.646222 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78c43e83-40eb-4b33-981a-14971574051b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:50.647049 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78c43e83-40eb-4b33-981a-14971574051b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:50.647799 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78c43e83-40eb-4b33-981a-14971574051b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:50.648928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78c43e83-40eb-4b33-981a-14971574051b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:50.649731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78c43e83-40eb-4b33-981a-14971574051b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:50.650401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-78c43e83-40eb-4b33-981a-14971574051b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:50.807820 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-78c43e83-40eb-4b33-981a-14971574051b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:50.816410 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-78c43e83-40eb-4b33-981a-14971574051b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1367 microversion: 2.1 time: 0.182787 Aug 26 06:27:50.816984 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 584/1176] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:50 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:51.840824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a959f087-bbff-4093-809b-3cf13960bf60 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:51.840824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a959f087-bbff-4093-809b-3cf13960bf60 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:51.847650 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a959f087-bbff-4093-809b-3cf13960bf60 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:51.848164 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a959f087-bbff-4093-809b-3cf13960bf60 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:51.848641 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a959f087-bbff-4093-809b-3cf13960bf60 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:51.849432 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a959f087-bbff-4093-809b-3cf13960bf60 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:51.849916 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a959f087-bbff-4093-809b-3cf13960bf60 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:51.850338 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a959f087-bbff-4093-809b-3cf13960bf60 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:52.001822 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a959f087-bbff-4093-809b-3cf13960bf60 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:52.011109 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a959f087-bbff-4093-809b-3cf13960bf60 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1367 microversion: 2.1 time: 0.174905 Aug 26 06:27:52.012064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 593/1177] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:51 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:27:53.033311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d6b993d7-8d26-454a-9d9e-6dae53ac5c17 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:53.033875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d6b993d7-8d26-454a-9d9e-6dae53ac5c17 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:53.036245 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=6 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:27:53.041076 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d6b993d7-8d26-454a-9d9e-6dae53ac5c17 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:53.041565 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d6b993d7-8d26-454a-9d9e-6dae53ac5c17 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:53.041998 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d6b993d7-8d26-454a-9d9e-6dae53ac5c17 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:53.042763 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d6b993d7-8d26-454a-9d9e-6dae53ac5c17 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:53.043184 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d6b993d7-8d26-454a-9d9e-6dae53ac5c17 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:53.050104 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d6b993d7-8d26-454a-9d9e-6dae53ac5c17 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:53.181126 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d6b993d7-8d26-454a-9d9e-6dae53ac5c17 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:53.191052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d6b993d7-8d26-454a-9d9e-6dae53ac5c17 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1367 microversion: 2.1 time: 0.161527 Aug 26 06:27:53.191655 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 585/1178] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:53 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:54.210778 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:27:54.212048 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=8 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:27:54.216396 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b1fa1562-0e6c-4729-bb9c-6b0e26d84157 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:54.217012 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b1fa1562-0e6c-4729-bb9c-6b0e26d84157 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:54.224443 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1fa1562-0e6c-4729-bb9c-6b0e26d84157 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:54.225265 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1fa1562-0e6c-4729-bb9c-6b0e26d84157 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:54.225865 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1fa1562-0e6c-4729-bb9c-6b0e26d84157 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:54.226735 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1fa1562-0e6c-4729-bb9c-6b0e26d84157 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:54.227201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1fa1562-0e6c-4729-bb9c-6b0e26d84157 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:54.227715 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b1fa1562-0e6c-4729-bb9c-6b0e26d84157 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:54.388486 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b1fa1562-0e6c-4729-bb9c-6b0e26d84157 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:54.396724 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b1fa1562-0e6c-4729-bb9c-6b0e26d84157 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1367 microversion: 2.1 time: 0.186712 Aug 26 06:27:54.397287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 594/1179] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:54 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:27:55.419704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f83d3baf-144c-4d2c-8eba-4151c36436d8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:55.420298 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f83d3baf-144c-4d2c-8eba-4151c36436d8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:55.427074 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f83d3baf-144c-4d2c-8eba-4151c36436d8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:55.427851 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f83d3baf-144c-4d2c-8eba-4151c36436d8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:55.428274 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f83d3baf-144c-4d2c-8eba-4151c36436d8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:55.428983 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f83d3baf-144c-4d2c-8eba-4151c36436d8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:55.429438 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f83d3baf-144c-4d2c-8eba-4151c36436d8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:55.429864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f83d3baf-144c-4d2c-8eba-4151c36436d8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:55.582660 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f83d3baf-144c-4d2c-8eba-4151c36436d8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:55.591606 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f83d3baf-144c-4d2c-8eba-4151c36436d8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1367 microversion: 2.1 time: 0.176556 Aug 26 06:27:55.592472 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 586/1180] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:55 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:55.961422 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-3760c65d-097d-4f5d-9168-66091fc9de82 req-37b84288-b40a-4ae0-a326-4fe4d1bb0d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20b2603-fcec-4d01-bc64-d8dea988ccfe", "name": "network-vif-plugged", "status": "completed", "tag": "1fd78a20-ca43-4b3a-8ff2-4f1c64768455"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:27:55.978726 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-3760c65d-097d-4f5d-9168-66091fc9de82 req-37b84288-b40a-4ae0-a326-4fe4d1bb0d4e service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:55.979644 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-3760c65d-097d-4f5d-9168-66091fc9de82 req-37b84288-b40a-4ae0-a326-4fe4d1bb0d4e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:55.980111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-3760c65d-097d-4f5d-9168-66091fc9de82 req-37b84288-b40a-4ae0-a326-4fe4d1bb0d4e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:55.992724 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-3760c65d-097d-4f5d-9168-66091fc9de82 req-37b84288-b40a-4ae0-a326-4fe4d1bb0d4e service nova] Creating event network-vif-plugged:1fd78a20-ca43-4b3a-8ff2-4f1c64768455 for instance c20b2603-fcec-4d01-bc64-d8dea988ccfe on hv-cinder-85391 Aug 26 06:27:55.998252 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-3760c65d-097d-4f5d-9168-66091fc9de82 req-37b84288-b40a-4ae0-a326-4fe4d1bb0d4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129918 Aug 26 06:27:55.998733 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 595/1181] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:27:56.613773 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0895e8f9-5a8b-4a64-bc14-02e62a41fd9a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:56.614605 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0895e8f9-5a8b-4a64-bc14-02e62a41fd9a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:56.621887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0895e8f9-5a8b-4a64-bc14-02e62a41fd9a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:56.622413 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0895e8f9-5a8b-4a64-bc14-02e62a41fd9a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:56.622882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0895e8f9-5a8b-4a64-bc14-02e62a41fd9a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:56.623598 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0895e8f9-5a8b-4a64-bc14-02e62a41fd9a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:56.624050 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0895e8f9-5a8b-4a64-bc14-02e62a41fd9a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:56.624478 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0895e8f9-5a8b-4a64-bc14-02e62a41fd9a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:56.783224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-0895e8f9-5a8b-4a64-bc14-02e62a41fd9a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:56.796552 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0895e8f9-5a8b-4a64-bc14-02e62a41fd9a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1367 microversion: 2.1 time: 0.186327 Aug 26 06:27:56.797539 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 587/1182] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:56 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:57.818927 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4ce23644-9c02-4666-b64b-2af8ceeea82b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:57.819621 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4ce23644-9c02-4666-b64b-2af8ceeea82b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:57.827166 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ce23644-9c02-4666-b64b-2af8ceeea82b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:57.827651 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ce23644-9c02-4666-b64b-2af8ceeea82b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:57.828088 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ce23644-9c02-4666-b64b-2af8ceeea82b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:57.828783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ce23644-9c02-4666-b64b-2af8ceeea82b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:57.829233 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ce23644-9c02-4666-b64b-2af8ceeea82b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:57.829657 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ce23644-9c02-4666-b64b-2af8ceeea82b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:57.976604 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4ce23644-9c02-4666-b64b-2af8ceeea82b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:57.989900 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4ce23644-9c02-4666-b64b-2af8ceeea82b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1367 microversion: 2.1 time: 0.175271 Aug 26 06:27:57.990857 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 596/1183] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:57 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:59.010930 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-001b2bf6-d479-4b88-a114-3968815b38bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:59.011715 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-001b2bf6-d479-4b88-a114-3968815b38bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:59.018747 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-001b2bf6-d479-4b88-a114-3968815b38bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:59.019240 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-001b2bf6-d479-4b88-a114-3968815b38bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:59.019680 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-001b2bf6-d479-4b88-a114-3968815b38bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:59.020387 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-001b2bf6-d479-4b88-a114-3968815b38bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:59.020845 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-001b2bf6-d479-4b88-a114-3968815b38bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:59.021274 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-001b2bf6-d479-4b88-a114-3968815b38bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:59.231890 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-001b2bf6-d479-4b88-a114-3968815b38bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:27:59.239978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-001b2bf6-d479-4b88-a114-3968815b38bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1558 microversion: 2.1 time: 0.232952 Aug 26 06:27:59.240593 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 588/1184] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:27:59 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:27:59.261120 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6c8c26ac-4518-46c5-afee-c3ad17e8c117 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:27:59.261637 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6c8c26ac-4518-46c5-afee-c3ad17e8c117 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:27:59.268181 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6c8c26ac-4518-46c5-afee-c3ad17e8c117 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:59.268693 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6c8c26ac-4518-46c5-afee-c3ad17e8c117 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:59.269127 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6c8c26ac-4518-46c5-afee-c3ad17e8c117 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:59.269824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6c8c26ac-4518-46c5-afee-c3ad17e8c117 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:27:59.270277 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6c8c26ac-4518-46c5-afee-c3ad17e8c117 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:27:59.270941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6c8c26ac-4518-46c5-afee-c3ad17e8c117 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:27:59.352357 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6c8c26ac-4518-46c5-afee-c3ad17e8c117 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094932 Aug 26 06:27:59.353368 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 597/1185] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 06:27:59 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:28:00.792312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-187b3813-22a0-49ef-aecc-8eaca5fdde74 req-afcdefa0-9123-4aaf-92ce-25facacd64b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c20b2603-fcec-4d01-bc64-d8dea988ccfe", "tag": "1fd78a20-ca43-4b3a-8ff2-4f1c64768455"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:00.806170 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-187b3813-22a0-49ef-aecc-8eaca5fdde74 req-afcdefa0-9123-4aaf-92ce-25facacd64b8 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:00.806668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-187b3813-22a0-49ef-aecc-8eaca5fdde74 req-afcdefa0-9123-4aaf-92ce-25facacd64b8 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:00.807946 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-187b3813-22a0-49ef-aecc-8eaca5fdde74 req-afcdefa0-9123-4aaf-92ce-25facacd64b8 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:00.824302 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-187b3813-22a0-49ef-aecc-8eaca5fdde74 req-afcdefa0-9123-4aaf-92ce-25facacd64b8 service nova] Creating event network-changed:1fd78a20-ca43-4b3a-8ff2-4f1c64768455 for instance c20b2603-fcec-4d01-bc64-d8dea988ccfe on hv-cinder-85391 Aug 26 06:28:00.829769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-187b3813-22a0-49ef-aecc-8eaca5fdde74 req-afcdefa0-9123-4aaf-92ce-25facacd64b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042004 Aug 26 06:28:00.830565 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 589/1186] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:28:01.465680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6394df9e-c068-4191-b408-4867d952074b tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:01.466286 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6394df9e-c068-4191-b408-4867d952074b tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:01.491301 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6394df9e-c068-4191-b408-4867d952074b tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:01.493435 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6394df9e-c068-4191-b408-4867d952074b tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:01.496724 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6394df9e-c068-4191-b408-4867d952074b tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:01.502303 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6394df9e-c068-4191-b408-4867d952074b tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:01.503364 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6394df9e-c068-4191-b408-4867d952074b tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:01.520334 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6394df9e-c068-4191-b408-4867d952074b tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:01.572207 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6394df9e-c068-4191-b408-4867d952074b tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Going to try to terminate instance {{(pid=121343) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:28:01.581164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-797c1216-2237-44c5-8734-2abaffcf27cf req-a4089a42-8ae9-4e8d-81cd-afa589af125c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e760f027-a590-4387-ab32-7dca29d29335", "tag": "ab5e913e-41a3-4c93-830a-f63879ab1522"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:01.593927 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-797c1216-2237-44c5-8734-2abaffcf27cf req-a4089a42-8ae9-4e8d-81cd-afa589af125c service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:01.594746 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-797c1216-2237-44c5-8734-2abaffcf27cf req-a4089a42-8ae9-4e8d-81cd-afa589af125c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:01.595391 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-797c1216-2237-44c5-8734-2abaffcf27cf req-a4089a42-8ae9-4e8d-81cd-afa589af125c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:01.608479 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-797c1216-2237-44c5-8734-2abaffcf27cf req-a4089a42-8ae9-4e8d-81cd-afa589af125c service nova] Creating event network-changed:ab5e913e-41a3-4c93-830a-f63879ab1522 for instance e760f027-a590-4387-ab32-7dca29d29335 on hv-cinder-85391 Aug 26 06:28:01.614398 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-797c1216-2237-44c5-8734-2abaffcf27cf req-a4089a42-8ae9-4e8d-81cd-afa589af125c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142193 Aug 26 06:28:01.615953 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 590/1187] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:28:02.298794 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6394df9e-c068-4191-b408-4867d952074b tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 204 len: 0 microversion: 2.1 time: 0.837180 Aug 26 06:28:02.302052 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 598/1188] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:28:01 2022] DELETE /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 06:28:02.313900 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d426ea63-8f7c-4f4c-ad03-eb166e0c12ae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:02.316325 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d426ea63-8f7c-4f4c-ad03-eb166e0c12ae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:02.328129 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d426ea63-8f7c-4f4c-ad03-eb166e0c12ae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:02.328687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d426ea63-8f7c-4f4c-ad03-eb166e0c12ae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:02.329143 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d426ea63-8f7c-4f4c-ad03-eb166e0c12ae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:02.330228 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d426ea63-8f7c-4f4c-ad03-eb166e0c12ae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:02.331362 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d426ea63-8f7c-4f4c-ad03-eb166e0c12ae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:02.332159 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d426ea63-8f7c-4f4c-ad03-eb166e0c12ae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:02.566487 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d426ea63-8f7c-4f4c-ad03-eb166e0c12ae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:02.575863 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d426ea63-8f7c-4f4c-ad03-eb166e0c12ae tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1578 microversion: 2.1 time: 0.269680 Aug 26 06:28:02.576444 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 591/1189] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:02 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1578 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:28:03.328289 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-40d9ca9a-a500-406c-b391-84423feff628 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:03.328977 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-40d9ca9a-a500-406c-b391-84423feff628 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:03.340091 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40d9ca9a-a500-406c-b391-84423feff628 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:03.340091 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40d9ca9a-a500-406c-b391-84423feff628 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:03.340091 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40d9ca9a-a500-406c-b391-84423feff628 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:03.340373 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40d9ca9a-a500-406c-b391-84423feff628 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:03.340703 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40d9ca9a-a500-406c-b391-84423feff628 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:03.341121 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-40d9ca9a-a500-406c-b391-84423feff628 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:03.371854 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-40d9ca9a-a500-406c-b391-84423feff628 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Going to try to terminate instance {{(pid=121343) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:28:03.598148 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-544106ca-3feb-4e57-84d0-eda3ed7f8e5e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:03.598892 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-544106ca-3feb-4e57-84d0-eda3ed7f8e5e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:03.606370 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-544106ca-3feb-4e57-84d0-eda3ed7f8e5e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:03.608040 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-544106ca-3feb-4e57-84d0-eda3ed7f8e5e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:03.608040 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-544106ca-3feb-4e57-84d0-eda3ed7f8e5e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:03.608040 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-544106ca-3feb-4e57-84d0-eda3ed7f8e5e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:03.608585 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-544106ca-3feb-4e57-84d0-eda3ed7f8e5e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:03.609019 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-544106ca-3feb-4e57-84d0-eda3ed7f8e5e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:03.745064 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-544106ca-3feb-4e57-84d0-eda3ed7f8e5e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:03.755335 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-544106ca-3feb-4e57-84d0-eda3ed7f8e5e tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1459 microversion: 2.1 time: 0.161194 Aug 26 06:28:03.759849 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 592/1190] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:03 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1459 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:28:03.760605 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-f317d411-aaa3-4502-bcb1-1d56f83ba9ff req-8055f589-2979-4e9a-8383-a6ec617bc3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4228acc2-99a7-47c3-9cef-92c0f7bcb7b0", "tag": "16e251e3-f929-404a-95a5-e7b555e4782f"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:03.770151 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f317d411-aaa3-4502-bcb1-1d56f83ba9ff req-8055f589-2979-4e9a-8383-a6ec617bc3e8 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:03.770666 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f317d411-aaa3-4502-bcb1-1d56f83ba9ff req-8055f589-2979-4e9a-8383-a6ec617bc3e8 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:03.771079 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f317d411-aaa3-4502-bcb1-1d56f83ba9ff req-8055f589-2979-4e9a-8383-a6ec617bc3e8 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:03.783625 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-f317d411-aaa3-4502-bcb1-1d56f83ba9ff req-8055f589-2979-4e9a-8383-a6ec617bc3e8 service nova] Creating event network-changed:16e251e3-f929-404a-95a5-e7b555e4782f for instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 on hv-cinder-85391 Aug 26 06:28:03.789749 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-f317d411-aaa3-4502-bcb1-1d56f83ba9ff req-8055f589-2979-4e9a-8383-a6ec617bc3e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032638 Aug 26 06:28:03.790588 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 593/1191] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:28:03.955606 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-40d9ca9a-a500-406c-b391-84423feff628 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 204 len: 0 microversion: 2.1 time: 0.634715 Aug 26 06:28:03.961253 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 599/1192] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:28:03 2022] DELETE /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 06:28:03.969020 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5125a944-e932-469f-bcb9-9b562cdadfbe tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:03.970115 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5125a944-e932-469f-bcb9-9b562cdadfbe tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:03.985909 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5125a944-e932-469f-bcb9-9b562cdadfbe tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:03.992972 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5125a944-e932-469f-bcb9-9b562cdadfbe tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:03.992972 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5125a944-e932-469f-bcb9-9b562cdadfbe tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:03.994190 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5125a944-e932-469f-bcb9-9b562cdadfbe tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:03.995592 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5125a944-e932-469f-bcb9-9b562cdadfbe tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:03.996479 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5125a944-e932-469f-bcb9-9b562cdadfbe tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:04.182196 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5125a944-e932-469f-bcb9-9b562cdadfbe tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:04.190746 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5125a944-e932-469f-bcb9-9b562cdadfbe tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.228389 Aug 26 06:28:04.191519 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 594/1193] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:03 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:28:04.552360 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-034eb52e-068c-46a6-ab79-10c2a3a1dbb7 req-08e3a5f7-e2f2-4ee9-a287-3a6c46889a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e760f027-a590-4387-ab32-7dca29d29335", "name": "network-vif-deleted", "tag": "ab5e913e-41a3-4c93-830a-f63879ab1522"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:04.562969 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-034eb52e-068c-46a6-ab79-10c2a3a1dbb7 req-08e3a5f7-e2f2-4ee9-a287-3a6c46889a0a service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:04.563448 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-034eb52e-068c-46a6-ab79-10c2a3a1dbb7 req-08e3a5f7-e2f2-4ee9-a287-3a6c46889a0a service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:04.563878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-034eb52e-068c-46a6-ab79-10c2a3a1dbb7 req-08e3a5f7-e2f2-4ee9-a287-3a6c46889a0a service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:04.575765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-034eb52e-068c-46a6-ab79-10c2a3a1dbb7 req-08e3a5f7-e2f2-4ee9-a287-3a6c46889a0a service nova] Creating event network-vif-deleted:ab5e913e-41a3-4c93-830a-f63879ab1522 for instance e760f027-a590-4387-ab32-7dca29d29335 on hv-cinder-85391 Aug 26 06:28:04.580620 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-034eb52e-068c-46a6-ab79-10c2a3a1dbb7 req-08e3a5f7-e2f2-4ee9-a287-3a6c46889a0a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032480 Aug 26 06:28:04.584693 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 600/1194] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:28:04.777397 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ffda6de1-8d77-4b63-8c98-6b13608af6e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:04.777967 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ffda6de1-8d77-4b63-8c98-6b13608af6e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:04.784529 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffda6de1-8d77-4b63-8c98-6b13608af6e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:04.785027 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffda6de1-8d77-4b63-8c98-6b13608af6e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:04.785457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffda6de1-8d77-4b63-8c98-6b13608af6e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:04.786169 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffda6de1-8d77-4b63-8c98-6b13608af6e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:04.786644 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffda6de1-8d77-4b63-8c98-6b13608af6e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:04.787069 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ffda6de1-8d77-4b63-8c98-6b13608af6e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:04.860401 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ffda6de1-8d77-4b63-8c98-6b13608af6e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:04.868941 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ffda6de1-8d77-4b63-8c98-6b13608af6e7 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1391 microversion: 2.1 time: 0.095772 Aug 26 06:28:04.869237 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 595/1195] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:04 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1391 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:05.214138 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-284828fe-4c76-4909-be8f-9c052a784295 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:05.214908 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-284828fe-4c76-4909-be8f-9c052a784295 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:05.223937 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-284828fe-4c76-4909-be8f-9c052a784295 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:05.224431 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-284828fe-4c76-4909-be8f-9c052a784295 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:05.226835 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-284828fe-4c76-4909-be8f-9c052a784295 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:05.226835 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-284828fe-4c76-4909-be8f-9c052a784295 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:05.226835 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-284828fe-4c76-4909-be8f-9c052a784295 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:05.226835 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-284828fe-4c76-4909-be8f-9c052a784295 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:05.402042 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-284828fe-4c76-4909-be8f-9c052a784295 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:05.407235 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-284828fe-4c76-4909-be8f-9c052a784295 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1567 microversion: 2.1 time: 0.197469 Aug 26 06:28:05.407933 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 601/1196] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:05 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:05.892082 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:05.892622 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:05.900526 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:05.901178 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:05.901993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:05.902942 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:05.903400 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:05.903826 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:05.940818 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:05.941296 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:05.941723 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:05.942162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lazy-loading 'fault' on Instance uuid e760f027-a590-4387-ab32-7dca29d29335 {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:28:05.989454 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:05.999642 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-99ff5666-ece1-421d-9d7b-1360c44ad524 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1231 microversion: 2.1 time: 0.111522 Aug 26 06:28:06.000406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 596/1197] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:05 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1231 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:06.437145 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ee413e3d-5127-4d2c-ae36-65e7b3b360ff tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:06.437801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ee413e3d-5127-4d2c-ae36-65e7b3b360ff tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:06.466228 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee413e3d-5127-4d2c-ae36-65e7b3b360ff tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:06.466228 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee413e3d-5127-4d2c-ae36-65e7b3b360ff tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:06.466228 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee413e3d-5127-4d2c-ae36-65e7b3b360ff tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:06.466228 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee413e3d-5127-4d2c-ae36-65e7b3b360ff tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:06.466942 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee413e3d-5127-4d2c-ae36-65e7b3b360ff tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:06.466942 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ee413e3d-5127-4d2c-ae36-65e7b3b360ff tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:06.531907 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-ee413e3d-5127-4d2c-ae36-65e7b3b360ff tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:06.541386 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ee413e3d-5127-4d2c-ae36-65e7b3b360ff tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1383 microversion: 2.1 time: 0.109282 Aug 26 06:28:06.541386 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 602/1198] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:06 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1383 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:28:06.598507 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-7f07368d-774e-4414-976f-8fcc752b00ec req-502057cf-1d36-4ae3-9110-e83a2e71a7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4228acc2-99a7-47c3-9cef-92c0f7bcb7b0", "name": "network-vif-deleted", "tag": "16e251e3-f929-404a-95a5-e7b555e4782f"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:06.610443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-7f07368d-774e-4414-976f-8fcc752b00ec req-502057cf-1d36-4ae3-9110-e83a2e71a7e1 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:06.610950 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-7f07368d-774e-4414-976f-8fcc752b00ec req-502057cf-1d36-4ae3-9110-e83a2e71a7e1 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:06.611382 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-7f07368d-774e-4414-976f-8fcc752b00ec req-502057cf-1d36-4ae3-9110-e83a2e71a7e1 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:06.625832 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-7f07368d-774e-4414-976f-8fcc752b00ec req-502057cf-1d36-4ae3-9110-e83a2e71a7e1 service nova] Creating event network-vif-deleted:16e251e3-f929-404a-95a5-e7b555e4782f for instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 on hv-cinder-85391 Aug 26 06:28:06.630855 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-7f07368d-774e-4414-976f-8fcc752b00ec req-502057cf-1d36-4ae3-9110-e83a2e71a7e1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038841 Aug 26 06:28:06.631704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 597/1199] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:28:07.022287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:07.022930 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:07.029329 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:07.029809 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:07.030253 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:07.030992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:07.031428 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:07.031845 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:07.067475 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:07.067950 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:07.068380 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:07.068828 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lazy-loading 'fault' on Instance uuid e760f027-a590-4387-ab32-7dca29d29335 {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:28:07.110417 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:07.117978 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c383e764-9c83-41ce-a888-94f6c8522f9a tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 200 len: 1185 microversion: 2.1 time: 0.099580 Aug 26 06:28:07.118538 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 603/1200] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:07 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 1185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:07.563572 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:07.564270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:07.570981 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:07.571465 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:07.571902 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:07.572636 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:07.573445 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:07.573933 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:07.576787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=89 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:28:07.606372 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:28:07.611732 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:07.612304 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:07.612742 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:07.613193 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lazy-loading 'fault' on Instance uuid 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:28:07.671768 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9ebeec374454468aae1d2b5fde21648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e8949a7d05434396f8e8631f2cdb72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:07.680527 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-423d7560-c605-43ad-95c3-9987ed084075 tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 200 len: 1225 microversion: 2.1 time: 0.120975 Aug 26 06:28:07.681115 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 598/1201] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:07 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:08.140341 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:08.141027 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: e760f027-a590-4387-ab32-7dca29d29335] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:08.147678 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:08.148089 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:08.148522 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:08.149209 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:08.149656 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:08.150073 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:08.154517 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:28:08.164496 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] HTTP exception thrown: Instance e760f027-a590-4387-ab32-7dca29d29335 could not be found. Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Request method failure captured: Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 HTTP/1.1 Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGX25XWp7tsU__iZbfd7vXbWsAXLyLrFONNJMqX0cA60pcM0k9Gh1cRXoCOz2ainB7LwOiSZU7AQhtasImzIf8Q_BLMeu_fqC_GGRfp081V9aeb6Zuc2Cz-Wjqma-QX1ALyVbuGRcVN1gQV6j2RyAo4aYYrcbneo1AD1ycfoxQ_-wP0 Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: fde0e661bd5646bab91b5e6b623a2e7e Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:28:08.166184 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: fde0e661bd5646bab91b5e6b623a2e7e Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-TestVolumeBootPattern-727138204-project Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 2f141efe3bb74587b5ba13f0cd5d89db Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-TestVolumeBootPattern-727138204-project Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance e760f027-a590-4387-ab32-7dca29d29335 could not be found. Aug 26 06:28:08.168084 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'e760f027-a590-4387-ab32-7dca29d29335'} Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e760f027-a590-4387-ab32-7dca29d29335 could not be found. Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:28:08.169013 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e760f027-a590-4387-ab32-7dca29d29335 could not be found. Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e760f027-a590-4387-ab32-7dca29d29335 could not be found. Aug 26 06:28:08.170609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:08.172037 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Returning 404 to user: Instance e760f027-a590-4387-ab32-7dca29d29335 could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:28:08.172037 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0651c6a0-dd51-4139-b665-44c2fb2bc312 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335" status: 404 len: 111 microversion: 2.1 time: 0.031449 Aug 26 06:28:08.172037 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 604/1202] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:08 2022] GET /compute/v2.1/servers/e760f027-a590-4387-ab32-7dca29d29335 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:28:08.702069 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:08.702726 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] [instance: 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:08.710472 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:08.710984 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:08.711460 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:08.712156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:08.712635 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:08.713695 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:08.727621 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] HTTP exception thrown: Instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 could not be found. Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Request method failure captured: Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 HTTP/1.1 Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGbIKqi8e_OzgCVjAT_AtwBpYEjabaswl1GQi-YyuArtaRxce0A7eZ09l-0RPTdTxD2dBJfaUXQvmUqDZF69ZsjExH_zT9ME8yAez2KTw6qXFIknrHUhRHTlYTB8qio56PQvv_66fD6mOCRJV_ynWZD_1f4VMcukl8NHBpwE4eAfXiM Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: 52e8949a7d05434396f8e8631f2cdb72 Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-TestShelveInstance-823285278 Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:28:08.729383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52e8949a7d05434396f8e8631f2cdb72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52e8949a7d05434396f8e8631f2cdb72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52e8949a7d05434396f8e8631f2cdb72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52e8949a7d05434396f8e8631f2cdb72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-TestShelveInstance-823285278 Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: 52e8949a7d05434396f8e8631f2cdb72 Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-TestShelveInstance-823285278 Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-TestShelveInstance-823285278-project Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: a9ebeec374454468aae1d2b5fde21648 Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-TestShelveInstance-823285278-project Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 could not be found. Aug 26 06:28:08.731597 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '4228acc2-99a7-47c3-9cef-92c0f7bcb7b0'} Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 could not be found. Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:28:08.733312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 could not be found. Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 could not be found. Aug 26 06:28:08.735125 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:08.736567 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Returning 404 to user: Instance 4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:28:08.736567 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-a6de460a-6e82-441f-95d4-b56824f4121e tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0" status: 404 len: 111 microversion: 2.1 time: 0.033180 Aug 26 06:28:08.736567 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 599/1203] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:08 2022] GET /compute/v2.1/servers/4228acc2-99a7-47c3-9cef-92c0f7bcb7b0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:28:09.039114 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f8be8943-2cea-4263-abc0-ec56210ea91f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] Calling method '.version_select at 0x7f2f091d60d0>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:09.251907 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f8be8943-2cea-4263-abc0-ec56210ea91f tempest-TestShelveInstance-823285278 tempest-TestShelveInstance-823285278-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1121843873" status: 202 len: 0 microversion: 2.1 time: 0.217518 Aug 26 06:28:09.252628 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 605/1204] 10.222.0.40 () {58 vars in 1254 bytes} [Fri Aug 26 06:28:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1121843873 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:28:11.959893 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9e3da12d-a220-4f85-b719-3afd0d621e29 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:11.963402 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9e3da12d-a220-4f85-b719-3afd0d621e29 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:11.977578 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e3da12d-a220-4f85-b719-3afd0d621e29 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:11.978700 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e3da12d-a220-4f85-b719-3afd0d621e29 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:11.979750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e3da12d-a220-4f85-b719-3afd0d621e29 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:11.980989 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-947f18bf-c2e1-4e89-be79-470a9f927243 req-cd090911-9285-4055-b9bf-4a63d2be5b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce4ec4be-d09b-431b-93f0-062334195c69", "tag": "07d50961-0e64-446f-a7b3-9104f5a9a451"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:11.981518 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e3da12d-a220-4f85-b719-3afd0d621e29 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:11.982086 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e3da12d-a220-4f85-b719-3afd0d621e29 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:11.982722 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9e3da12d-a220-4f85-b719-3afd0d621e29 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:11.997789 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-947f18bf-c2e1-4e89-be79-470a9f927243 req-cd090911-9285-4055-b9bf-4a63d2be5b3f service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:11.998521 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-947f18bf-c2e1-4e89-be79-470a9f927243 req-cd090911-9285-4055-b9bf-4a63d2be5b3f service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:11.999357 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-947f18bf-c2e1-4e89-be79-470a9f927243 req-cd090911-9285-4055-b9bf-4a63d2be5b3f service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:12.026059 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9e3da12d-a220-4f85-b719-3afd0d621e29 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:28:12.087372 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-947f18bf-c2e1-4e89-be79-470a9f927243 req-cd090911-9285-4055-b9bf-4a63d2be5b3f service nova] Creating event network-changed:07d50961-0e64-446f-a7b3-9104f5a9a451 for instance ce4ec4be-d09b-431b-93f0-062334195c69 on hv-cinder-85391 Aug 26 06:28:12.096570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-947f18bf-c2e1-4e89-be79-470a9f927243 req-cd090911-9285-4055-b9bf-4a63d2be5b3f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123329 Aug 26 06:28:12.097996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 606/1205] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:28:12.549722 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9e3da12d-a220-4f85-b719-3afd0d621e29 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 204 len: 0 microversion: 2.1 time: 0.597208 Aug 26 06:28:12.554751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 600/1206] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:28:11 2022] DELETE /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:28:12.561265 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-92cc8f73-1cbc-4f8a-9ace-a7261d534285 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:12.562019 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-92cc8f73-1cbc-4f8a-9ace-a7261d534285 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:12.571720 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:28:12.574130 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-92cc8f73-1cbc-4f8a-9ace-a7261d534285 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:12.574901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-92cc8f73-1cbc-4f8a-9ace-a7261d534285 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:12.575834 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-92cc8f73-1cbc-4f8a-9ace-a7261d534285 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:12.576781 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-92cc8f73-1cbc-4f8a-9ace-a7261d534285 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:12.577610 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-92cc8f73-1cbc-4f8a-9ace-a7261d534285 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:12.578569 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-92cc8f73-1cbc-4f8a-9ace-a7261d534285 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:12.796726 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-92cc8f73-1cbc-4f8a-9ace-a7261d534285 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:12.816278 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-92cc8f73-1cbc-4f8a-9ace-a7261d534285 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1578 microversion: 2.1 time: 0.260035 Aug 26 06:28:12.818812 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 607/1207] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:12 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1578 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:13.847205 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d43073cc-457e-4c32-8c65-4fb0be38c14f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:13.848786 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d43073cc-457e-4c32-8c65-4fb0be38c14f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:13.860554 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d43073cc-457e-4c32-8c65-4fb0be38c14f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:13.873271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d43073cc-457e-4c32-8c65-4fb0be38c14f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:13.873271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d43073cc-457e-4c32-8c65-4fb0be38c14f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:13.873271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d43073cc-457e-4c32-8c65-4fb0be38c14f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:13.873271 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d43073cc-457e-4c32-8c65-4fb0be38c14f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:13.873811 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d43073cc-457e-4c32-8c65-4fb0be38c14f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:14.013331 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-d43073cc-457e-4c32-8c65-4fb0be38c14f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:14.023068 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d43073cc-457e-4c32-8c65-4fb0be38c14f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1578 microversion: 2.1 time: 0.185049 Aug 26 06:28:14.023656 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 601/1208] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:13 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:14.716886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-9bab79a1-ce48-4954-b3db-122321f91f17 req-32a0e3c0-67eb-49b8-b66b-d3bee838688e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4ec4be-d09b-431b-93f0-062334195c69", "name": "network-vif-deleted", "tag": "07d50961-0e64-446f-a7b3-9104f5a9a451"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:14.728697 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-9bab79a1-ce48-4954-b3db-122321f91f17 req-32a0e3c0-67eb-49b8-b66b-d3bee838688e service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:14.730068 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-9bab79a1-ce48-4954-b3db-122321f91f17 req-32a0e3c0-67eb-49b8-b66b-d3bee838688e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:14.730550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-9bab79a1-ce48-4954-b3db-122321f91f17 req-32a0e3c0-67eb-49b8-b66b-d3bee838688e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:14.742412 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-9bab79a1-ce48-4954-b3db-122321f91f17 req-32a0e3c0-67eb-49b8-b66b-d3bee838688e service nova] Creating event network-vif-deleted:07d50961-0e64-446f-a7b3-9104f5a9a451 for instance ce4ec4be-d09b-431b-93f0-062334195c69 on hv-cinder-85391 Aug 26 06:28:14.748297 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-9bab79a1-ce48-4954-b3db-122321f91f17 req-32a0e3c0-67eb-49b8-b66b-d3bee838688e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037416 Aug 26 06:28:14.749530 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 608/1209] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:28:15.047704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-86e9477c-e641-4d9a-bbdf-e81229de3821 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:15.050347 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-86e9477c-e641-4d9a-bbdf-e81229de3821 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:15.060668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-86e9477c-e641-4d9a-bbdf-e81229de3821 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:15.065340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-86e9477c-e641-4d9a-bbdf-e81229de3821 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:15.065340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-86e9477c-e641-4d9a-bbdf-e81229de3821 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:15.065340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-86e9477c-e641-4d9a-bbdf-e81229de3821 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:15.065340 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-86e9477c-e641-4d9a-bbdf-e81229de3821 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:15.065777 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-86e9477c-e641-4d9a-bbdf-e81229de3821 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:15.146244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-86e9477c-e641-4d9a-bbdf-e81229de3821 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:15.156430 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-86e9477c-e641-4d9a-bbdf-e81229de3821 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1226 microversion: 2.1 time: 0.113336 Aug 26 06:28:15.158073 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 602/1210] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:15 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1226 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:16.185288 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:16.185979 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:16.192963 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:16.193452 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:16.194098 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:16.194834 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:16.195287 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:16.195758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:16.232378 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:16.232878 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:16.233295 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:16.233910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lazy-loading 'fault' on Instance uuid ce4ec4be-d09b-431b-93f0-062334195c69 {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:28:16.282890 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f141efe3bb74587b5ba13f0cd5d89db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde0e661bd5646bab91b5e6b623a2e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:16.297169 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d7169a92-c543-4343-a4d6-7d28f0990ab1 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 200 len: 1231 microversion: 2.1 time: 0.116822 Aug 26 06:28:16.298467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 609/1211] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:16 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 1231 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:17.321555 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:17.322453 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: ce4ec4be-d09b-431b-93f0-062334195c69] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:17.329830 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:17.330411 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:17.330969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:17.331752 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:17.332441 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:17.332932 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:17.348170 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] HTTP exception thrown: Instance ce4ec4be-d09b-431b-93f0-062334195c69 could not be found. Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Request method failure captured: Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 HTTP/1.1 Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGX25XWp7tsU__iZbfd7vXbWsAXLyLrFONNJMqX0cA60pcM0k9Gh1cRXoCOz2ainB7LwOiSZU7AQhtasImzIf8Q_BLMeu_fqC_GGRfp081V9aeb6Zuc2Cz-Wjqma-QX1ALyVbuGRcVN1gQV6j2RyAo4aYYrcbneo1AD1ycfoxQ_-wP0 Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: fde0e661bd5646bab91b5e6b623a2e7e Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:28:17.350006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: fde0e661bd5646bab91b5e6b623a2e7e Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-TestVolumeBootPattern-727138204-project Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 2f141efe3bb74587b5ba13f0cd5d89db Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-TestVolumeBootPattern-727138204-project Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance ce4ec4be-d09b-431b-93f0-062334195c69 could not be found. Aug 26 06:28:17.351443 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'ce4ec4be-d09b-431b-93f0-062334195c69'} Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce4ec4be-d09b-431b-93f0-062334195c69 could not be found. Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:28:17.356837 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce4ec4be-d09b-431b-93f0-062334195c69 could not be found. Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce4ec4be-d09b-431b-93f0-062334195c69 could not be found. Aug 26 06:28:17.359108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:17.361560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Returning 404 to user: Instance ce4ec4be-d09b-431b-93f0-062334195c69 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:28:17.361560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-95403b9c-883d-450b-b27b-5a37e87c7da5 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69" status: 404 len: 111 microversion: 2.1 time: 0.034187 Aug 26 06:28:17.361560 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 603/1212] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:17 2022] GET /compute/v2.1/servers/ce4ec4be-d09b-431b-93f0-062334195c69 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:28:18.089667 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:18.091163 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:18.109023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:18.109023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:18.109023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:18.109023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:18.109470 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:18.109962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:18.129135 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] HTTP exception thrown: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Request method failure captured: Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: DELETE /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c HTTP/1.1 Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGX25XWp7tsU__iZbfd7vXbWsAXLyLrFONNJMqX0cA60pcM0k9Gh1cRXoCOz2ainB7LwOiSZU7AQhtasImzIf8Q_BLMeu_fqC_GGRfp081V9aeb6Zuc2Cz-Wjqma-QX1ALyVbuGRcVN1gQV6j2RyAo4aYYrcbneo1AD1ycfoxQ_-wP0 Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: fde0e661bd5646bab91b5e6b623a2e7e Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:28:18.130807 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: fde0e661bd5646bab91b5e6b623a2e7e Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-TestVolumeBootPattern-727138204-project Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 2f141efe3bb74587b5ba13f0cd5d89db Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-TestVolumeBootPattern-727138204-project Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:28:18.132155 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'f739aa85-1e49-4e21-ab74-9463ba8ffd4c'} Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:28:18.133003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:28:18.134601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:18.136992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Returning 404 to user: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:28:18.136992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b9772e33-4bce-429d-b694-ae257b82619d tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 404 len: 111 microversion: 2.1 time: 0.048413 Aug 26 06:28:18.136992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 610/1213] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:28:18 2022] DELETE /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:28:18.142536 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:18.143307 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] [instance: f739aa85-1e49-4e21-ab74-9463ba8ffd4c] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:18.149887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:18.151122 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:18.151563 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:18.152265 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:18.152718 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:18.153136 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:18.171696 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] HTTP exception thrown: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Request method failure captured: Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c HTTP/1.1 Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGX25XWp7tsU__iZbfd7vXbWsAXLyLrFONNJMqX0cA60pcM0k9Gh1cRXoCOz2ainB7LwOiSZU7AQhtasImzIf8Q_BLMeu_fqC_GGRfp081V9aeb6Zuc2Cz-Wjqma-QX1ALyVbuGRcVN1gQV6j2RyAo4aYYrcbneo1AD1ycfoxQ_-wP0 Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: fde0e661bd5646bab91b5e6b623a2e7e Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:28:18.173607 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fde0e661bd5646bab91b5e6b623a2e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: fde0e661bd5646bab91b5e6b623a2e7e Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-TestVolumeBootPattern-727138204 Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-TestVolumeBootPattern-727138204-project Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 2f141efe3bb74587b5ba13f0cd5d89db Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-TestVolumeBootPattern-727138204-project Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:28:18.175284 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'f739aa85-1e49-4e21-ab74-9463ba8ffd4c'} Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:28:18.176203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. Aug 26 06:28:18.177987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:18.179454 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Returning 404 to user: Instance f739aa85-1e49-4e21-ab74-9463ba8ffd4c could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:28:18.179454 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-7f2baddd-9ac7-4376-a0e7-7543b609a20f tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c" status: 404 len: 111 microversion: 2.1 time: 0.036319 Aug 26 06:28:18.179454 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 604/1214] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:18 2022] GET /compute/v2.1/servers/f739aa85-1e49-4e21-ab74-9463ba8ffd4c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 06:28:20.197480 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-2f7ab223-0506-42f2-9b2c-da1566f62450 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] Calling method '.version_select at 0x7f2f08fec160>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:20.359106 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-2f7ab223-0506-42f2-9b2c-da1566f62450 tempest-TestVolumeBootPattern-727138204 tempest-TestVolumeBootPattern-727138204-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1551638034" status: 202 len: 0 microversion: 2.1 time: 0.165263 Aug 26 06:28:20.359607 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 611/1215] 10.222.0.40 () {58 vars in 1263 bytes} [Fri Aug 26 06:28:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1551638034 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:28:35.226893 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-df9824b3-6c28-46ab-8ea8-0c170f513802 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:35.227547 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-df9824b3-6c28-46ab-8ea8-0c170f513802 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:35.232246 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:28:35.233576 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:28:35.243088 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df9824b3-6c28-46ab-8ea8-0c170f513802 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:35.248833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df9824b3-6c28-46ab-8ea8-0c170f513802 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:35.248833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df9824b3-6c28-46ab-8ea8-0c170f513802 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:35.248833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df9824b3-6c28-46ab-8ea8-0c170f513802 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:35.248833 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df9824b3-6c28-46ab-8ea8-0c170f513802 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:35.249269 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-df9824b3-6c28-46ab-8ea8-0c170f513802 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:35.279718 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-df9824b3-6c28-46ab-8ea8-0c170f513802 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe/ips" status: 200 len: 151 microversion: 2.1 time: 0.057140 Aug 26 06:28:35.280550 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 605/1216] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 06:28:35 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:28:35.292507 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=20 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:28:35.294611 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:28:35.298576 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6578d16b-83fa-4ddd-8eda-55bde34234aa"}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:35.301636 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:35.311050 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:35.311537 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:35.312748 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:35.312748 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:35.313109 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:35.313559 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:35.431215 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Invalid volume: volume 6578d16b-83fa-4ddd-8eda-55bde34234aa is already attached to instances: 9ae98859-f32e-4f5b-b796-a330a860f02a Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: POST /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe/os-volume_attachments HTTP/1.1 Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 74 Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:28:35.433256 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {"volumeAttachment": {"volumeId": "6578d16b-83fa-4ddd-8eda-55bde34234aa"}} Aug 26 06:28:35.438941 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Invalid volume: volume 6578d16b-83fa-4ddd-8eda-55bde34234aa is already attached to instances: 9ae98859-f32e-4f5b-b796-a330a860f02a Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'server_id': 'c20b2603-fcec-4d01-bc64-d8dea988ccfe', 'body': {'volumeAttachment': {'volumeId': '6578d16b-83fa-4ddd-8eda-55bde34234aa'}}} Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6578d16b-83fa-4ddd-8eda-55bde34234aa is already attached to instances: 9ae98859-f32e-4f5b-b796-a330a860f02a Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:35.440065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6578d16b-83fa-4ddd-8eda-55bde34234aa is already attached to instances: 9ae98859-f32e-4f5b-b796-a330a860f02a Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:35.441904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:35.443668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:35.443668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:28:35.443668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:28:35.443668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6578d16b-83fa-4ddd-8eda-55bde34234aa is already attached to instances: 9ae98859-f32e-4f5b-b796-a330a860f02a Aug 26 06:28:35.443668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:35.443668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 400 to user: Invalid volume: volume 6578d16b-83fa-4ddd-8eda-55bde34234aa is already attached to instances: 9ae98859-f32e-4f5b-b796-a330a860f02a {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:28:35.443668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-232cf588-15b1-48ae-afe5-6f310ee6ad5f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.146104 Aug 26 06:28:35.443668 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 612/1217] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:28:35 2022] POST /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe/os-volume_attachments => generated 174 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 06:28:35.444790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-fd841e70-17dc-43ee-a817-db60176549aa tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:35.445282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fd841e70-17dc-43ee-a817-db60176549aa tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:35.454953 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd841e70-17dc-43ee-a817-db60176549aa tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:35.455475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd841e70-17dc-43ee-a817-db60176549aa tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:35.455938 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd841e70-17dc-43ee-a817-db60176549aa tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:35.456725 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd841e70-17dc-43ee-a817-db60176549aa tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:35.457399 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd841e70-17dc-43ee-a817-db60176549aa tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:35.458172 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-fd841e70-17dc-43ee-a817-db60176549aa tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:35.496747 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-fd841e70-17dc-43ee-a817-db60176549aa tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:28:35.959316 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-fd841e70-17dc-43ee-a817-db60176549aa tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 204 len: 0 microversion: 2.1 time: 0.517995 Aug 26 06:28:35.959922 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 606/1218] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:28:35 2022] DELETE /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 06:28:35.968449 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-457e6ff1-aec6-4cf3-a92b-89f9c276962a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:35.969065 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-457e6ff1-aec6-4cf3-a92b-89f9c276962a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:35.975818 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-457e6ff1-aec6-4cf3-a92b-89f9c276962a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:35.976311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-457e6ff1-aec6-4cf3-a92b-89f9c276962a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:35.976783 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-457e6ff1-aec6-4cf3-a92b-89f9c276962a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:35.977481 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-457e6ff1-aec6-4cf3-a92b-89f9c276962a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:35.978003 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-457e6ff1-aec6-4cf3-a92b-89f9c276962a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:35.978589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-457e6ff1-aec6-4cf3-a92b-89f9c276962a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:36.127386 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-457e6ff1-aec6-4cf3-a92b-89f9c276962a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:36.138752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-457e6ff1-aec6-4cf3-a92b-89f9c276962a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1683 microversion: 2.1 time: 0.173101 Aug 26 06:28:36.138752 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 613/1219] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:35 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:37.163260 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f9936d98-94ff-4117-9794-ec717dcf87f8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:37.164521 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f9936d98-94ff-4117-9794-ec717dcf87f8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:37.176668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9936d98-94ff-4117-9794-ec717dcf87f8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:37.177364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9936d98-94ff-4117-9794-ec717dcf87f8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:37.178359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9936d98-94ff-4117-9794-ec717dcf87f8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:37.179221 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9936d98-94ff-4117-9794-ec717dcf87f8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:37.179845 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9936d98-94ff-4117-9794-ec717dcf87f8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:37.180310 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f9936d98-94ff-4117-9794-ec717dcf87f8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:37.326699 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f9936d98-94ff-4117-9794-ec717dcf87f8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:37.334813 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f9936d98-94ff-4117-9794-ec717dcf87f8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1683 microversion: 2.1 time: 0.177198 Aug 26 06:28:37.335387 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 607/1220] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:37 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:28:38.362144 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3989dcf5-0ea0-4a5b-acb6-5773b60fa651 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:38.362809 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3989dcf5-0ea0-4a5b-acb6-5773b60fa651 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:38.369982 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3989dcf5-0ea0-4a5b-acb6-5773b60fa651 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:38.370478 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3989dcf5-0ea0-4a5b-acb6-5773b60fa651 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:38.370950 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3989dcf5-0ea0-4a5b-acb6-5773b60fa651 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:38.371670 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3989dcf5-0ea0-4a5b-acb6-5773b60fa651 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:38.372115 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3989dcf5-0ea0-4a5b-acb6-5773b60fa651 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:38.372536 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3989dcf5-0ea0-4a5b-acb6-5773b60fa651 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:38.444578 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-3989dcf5-0ea0-4a5b-acb6-5773b60fa651 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:38.453955 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3989dcf5-0ea0-4a5b-acb6-5773b60fa651 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1616 microversion: 2.1 time: 0.096035 Aug 26 06:28:38.454545 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 614/1221] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:38 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1616 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:38.599501 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-fb6fe89f-b3ec-4f0b-9267-15d4ac358fea req-0cbfb7e7-24ad-4240-872c-50e294a9f82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20b2603-fcec-4d01-bc64-d8dea988ccfe", "name": "network-vif-deleted", "tag": "1fd78a20-ca43-4b3a-8ff2-4f1c64768455"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:38.611731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-fb6fe89f-b3ec-4f0b-9267-15d4ac358fea req-0cbfb7e7-24ad-4240-872c-50e294a9f82e service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:38.612218 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-fb6fe89f-b3ec-4f0b-9267-15d4ac358fea req-0cbfb7e7-24ad-4240-872c-50e294a9f82e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:38.612653 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-fb6fe89f-b3ec-4f0b-9267-15d4ac358fea req-0cbfb7e7-24ad-4240-872c-50e294a9f82e service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:38.626903 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-fb6fe89f-b3ec-4f0b-9267-15d4ac358fea req-0cbfb7e7-24ad-4240-872c-50e294a9f82e service nova] Creating event network-vif-deleted:1fd78a20-ca43-4b3a-8ff2-4f1c64768455 for instance c20b2603-fcec-4d01-bc64-d8dea988ccfe on hv-cinder-85391 Aug 26 06:28:38.632788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-fb6fe89f-b3ec-4f0b-9267-15d4ac358fea req-0cbfb7e7-24ad-4240-872c-50e294a9f82e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037160 Aug 26 06:28:38.633405 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 608/1222] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:28:39.479933 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:39.484075 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:39.489493 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:39.489983 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:39.490416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:39.491162 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:39.491609 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:39.492185 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:39.531275 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:39.531763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:39.532204 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:39.532655 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lazy-loading 'fault' on Instance uuid c20b2603-fcec-4d01-bc64-d8dea988ccfe {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:28:39.590747 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:39.602418 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-579e5463-7793-4e6c-b221-aaf1d4daeee3 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 200 len: 1332 microversion: 2.1 time: 0.127480 Aug 26 06:28:39.604589 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 615/1223] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:39 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 1332 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:40.640642 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:40.640642 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:40.647239 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:40.648039 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:40.648167 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:40.654039 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:40.654039 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:40.654039 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:40.665077 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe HTTP/1.1 Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:28:40.666667 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:28:40.668342 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'c20b2603-fcec-4d01-bc64-d8dea988ccfe'} Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:28:40.669406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:28:40.671210 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:28:40.672875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:28:40.672875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d3bf6dcb-6b70-47e0-b6de-437dc0059527 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 404 len: 111 microversion: 2.1 time: 0.034095 Aug 26 06:28:40.672875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 609/1224] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:40 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:28:40.678568 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c5a5acd2-47dc-46b5-ba71-c18b15853b65 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '.version_select at 0x7f2f0c9375e0>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:41.025367 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c5a5acd2-47dc-46b5-ba71-c18b15853b65 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2108428117" status: 202 len: 0 microversion: 2.1 time: 0.350567 Aug 26 06:28:41.025832 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 616/1225] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Aug 26 06:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2108428117 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:28:42.162886 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-d1122714-9b07-4bf4-a060-7996292fc31b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:42.163880 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-d1122714-9b07-4bf4-a060-7996292fc31b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:42.172160 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1122714-9b07-4bf4-a060-7996292fc31b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:42.172663 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1122714-9b07-4bf4-a060-7996292fc31b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:42.173177 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1122714-9b07-4bf4-a060-7996292fc31b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:42.173955 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1122714-9b07-4bf4-a060-7996292fc31b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:42.174406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1122714-9b07-4bf4-a060-7996292fc31b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:42.174928 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-d1122714-9b07-4bf4-a060-7996292fc31b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:42.269867 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-d1122714-9b07-4bf4-a060-7996292fc31b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lazy-loading 'services' on Instance uuid 9ae98859-f32e-4f5b-b796-a330a860f02a {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:28:42.834534 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-d1122714-9b07-4bf4-a060-7996292fc31b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-volume_attachments/6578d16b-83fa-4ddd-8eda-55bde34234aa" status: 202 len: 0 microversion: 2.1 time: 0.675529 Aug 26 06:28:42.835668 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 610/1226] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:28:42 2022] DELETE /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-volume_attachments/6578d16b-83fa-4ddd-8eda-55bde34234aa => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 06:28:42.847848 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-23679742-791e-4273-afca-02aabc26be38 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:42.851483 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-23679742-791e-4273-afca-02aabc26be38 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:42.859996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-23679742-791e-4273-afca-02aabc26be38 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:42.860478 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-23679742-791e-4273-afca-02aabc26be38 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:42.860909 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-23679742-791e-4273-afca-02aabc26be38 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:42.861599 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-23679742-791e-4273-afca-02aabc26be38 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:42.862045 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-23679742-791e-4273-afca-02aabc26be38 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:42.862467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-23679742-791e-4273-afca-02aabc26be38 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:42.897254 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-23679742-791e-4273-afca-02aabc26be38 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056516 Aug 26 06:28:42.897814 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 617/1227] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:28:42 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:28:43.912162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-10d8db6a-f32a-4aad-878a-77ca616e288d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:43.914554 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-10d8db6a-f32a-4aad-878a-77ca616e288d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:43.922364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10d8db6a-f32a-4aad-878a-77ca616e288d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:43.922877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10d8db6a-f32a-4aad-878a-77ca616e288d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:43.923364 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10d8db6a-f32a-4aad-878a-77ca616e288d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:43.924067 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10d8db6a-f32a-4aad-878a-77ca616e288d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:43.924516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10d8db6a-f32a-4aad-878a-77ca616e288d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:43.924937 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-10d8db6a-f32a-4aad-878a-77ca616e288d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:43.967836 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-10d8db6a-f32a-4aad-878a-77ca616e288d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061330 Aug 26 06:28:43.968435 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 611/1228] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:28:43 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:28:44.981152 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c0ce3559-d173-4a35-88d8-328df5377683 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:44.983357 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c0ce3559-d173-4a35-88d8-328df5377683 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:44.995420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0ce3559-d173-4a35-88d8-328df5377683 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:44.995420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0ce3559-d173-4a35-88d8-328df5377683 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:44.995420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0ce3559-d173-4a35-88d8-328df5377683 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:44.995420 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0ce3559-d173-4a35-88d8-328df5377683 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:44.996126 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0ce3559-d173-4a35-88d8-328df5377683 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:44.996126 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0ce3559-d173-4a35-88d8-328df5377683 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:45.025206 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c0ce3559-d173-4a35-88d8-328df5377683 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048022 Aug 26 06:28:45.025765 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 618/1229] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:28:44 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 06:28:45.093186 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-4da021e1-81f3-4787-8f31-4d0ae8ba9730 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:45.093777 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4da021e1-81f3-4787-8f31-4d0ae8ba9730 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:45.100796 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4da021e1-81f3-4787-8f31-4d0ae8ba9730 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:45.101267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4da021e1-81f3-4787-8f31-4d0ae8ba9730 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:45.101704 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4da021e1-81f3-4787-8f31-4d0ae8ba9730 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:45.102658 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4da021e1-81f3-4787-8f31-4d0ae8ba9730 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:45.104359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4da021e1-81f3-4787-8f31-4d0ae8ba9730 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:45.104786 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-4da021e1-81f3-4787-8f31-4d0ae8ba9730 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:45.132302 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-4da021e1-81f3-4787-8f31-4d0ae8ba9730 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:28:45.638749 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-4da021e1-81f3-4787-8f31-4d0ae8ba9730 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 204 len: 0 microversion: 2.1 time: 0.549128 Aug 26 06:28:45.639263 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 612/1230] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:28:45 2022] DELETE /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:28:45.647909 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c6b6c656-e187-4660-a249-f9d0948137d4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:45.648561 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c6b6c656-e187-4660-a249-f9d0948137d4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:45.654905 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c6b6c656-e187-4660-a249-f9d0948137d4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:45.655382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c6b6c656-e187-4660-a249-f9d0948137d4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:45.655816 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c6b6c656-e187-4660-a249-f9d0948137d4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:45.656512 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c6b6c656-e187-4660-a249-f9d0948137d4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:45.656966 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c6b6c656-e187-4660-a249-f9d0948137d4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:45.657387 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c6b6c656-e187-4660-a249-f9d0948137d4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:45.802802 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c6b6c656-e187-4660-a249-f9d0948137d4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:45.812573 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c6b6c656-e187-4660-a249-f9d0948137d4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1682 microversion: 2.1 time: 0.168733 Aug 26 06:28:45.813150 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 619/1231] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:45 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:46.835437 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dc48d526-f252-4945-9b5c-a84de446bcd4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:46.836128 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-dc48d526-f252-4945-9b5c-a84de446bcd4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:46.845341 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc48d526-f252-4945-9b5c-a84de446bcd4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:46.845897 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc48d526-f252-4945-9b5c-a84de446bcd4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:46.846450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc48d526-f252-4945-9b5c-a84de446bcd4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:46.847381 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc48d526-f252-4945-9b5c-a84de446bcd4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:46.847972 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc48d526-f252-4945-9b5c-a84de446bcd4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:46.848516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc48d526-f252-4945-9b5c-a84de446bcd4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:47.008080 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-dc48d526-f252-4945-9b5c-a84de446bcd4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:47.016502 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-dc48d526-f252-4945-9b5c-a84de446bcd4 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1682 microversion: 2.1 time: 0.185375 Aug 26 06:28:47.017071 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 613/1232] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:46 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:48.039026 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-17a5fc2f-18d3-4d96-bdd8-06a30eaee11b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:48.039642 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-17a5fc2f-18d3-4d96-bdd8-06a30eaee11b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:48.046569 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17a5fc2f-18d3-4d96-bdd8-06a30eaee11b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:48.047085 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17a5fc2f-18d3-4d96-bdd8-06a30eaee11b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:48.047568 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17a5fc2f-18d3-4d96-bdd8-06a30eaee11b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:48.048342 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17a5fc2f-18d3-4d96-bdd8-06a30eaee11b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:48.048722 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17a5fc2f-18d3-4d96-bdd8-06a30eaee11b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:48.049197 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-17a5fc2f-18d3-4d96-bdd8-06a30eaee11b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:48.208756 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-17a5fc2f-18d3-4d96-bdd8-06a30eaee11b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:48.223390 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-17a5fc2f-18d3-4d96-bdd8-06a30eaee11b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1682 microversion: 2.1 time: 0.187729 Aug 26 06:28:48.224492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 620/1233] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:48 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:48.512094 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-01c77501-c1f2-4cd0-8759-8676da8355b7 req-372c3588-e227-43ca-9f89-274374c66c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae98859-f32e-4f5b-b796-a330a860f02a", "name": "network-vif-deleted", "tag": "dc8f2e1e-4654-4a97-af55-30d11a6929e3"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:48.526686 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-01c77501-c1f2-4cd0-8759-8676da8355b7 req-372c3588-e227-43ca-9f89-274374c66c1a service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:48.527181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-01c77501-c1f2-4cd0-8759-8676da8355b7 req-372c3588-e227-43ca-9f89-274374c66c1a service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:48.527855 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-01c77501-c1f2-4cd0-8759-8676da8355b7 req-372c3588-e227-43ca-9f89-274374c66c1a service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:48.545399 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-01c77501-c1f2-4cd0-8759-8676da8355b7 req-372c3588-e227-43ca-9f89-274374c66c1a service nova] Creating event network-vif-deleted:dc8f2e1e-4654-4a97-af55-30d11a6929e3 for instance 9ae98859-f32e-4f5b-b796-a330a860f02a on hv-cinder-85391 Aug 26 06:28:48.553246 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-01c77501-c1f2-4cd0-8759-8676da8355b7 req-372c3588-e227-43ca-9f89-274374c66c1a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044682 Aug 26 06:28:48.554420 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 614/1234] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:28:49.248089 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:49.249044 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:49.258511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:49.259835 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:49.260274 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:49.260989 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:49.261436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:49.261858 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:49.299560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:49.300038 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:49.300467 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:49.300924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lazy-loading 'fault' on Instance uuid 9ae98859-f32e-4f5b-b796-a330a860f02a {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:28:49.350308 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:49.360896 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-dbc71966-4f23-4fb8-8caf-824f2ab2261b tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1332 microversion: 2.1 time: 0.118121 Aug 26 06:28:49.361666 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 621/1235] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:49 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1332 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:28:50.387358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:50.387961 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:50.401450 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:50.401984 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:50.402901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:50.404108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:50.408395 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:50.408884 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:50.445506 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:50.446766 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:50.447359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:50.447993 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lazy-loading 'fault' on Instance uuid 9ae98859-f32e-4f5b-b796-a330a860f02a {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:28:50.499866 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:50.508270 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-621b1074-cfdb-4566-bffc-ca7469accaf2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 200 len: 1332 microversion: 2.1 time: 0.126487 Aug 26 06:28:50.509378 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 615/1236] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:50 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:51.530118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:51.530740 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:51.537269 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:51.537736 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:51.538170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:51.538886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:51.539343 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:51.539759 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:51.555149 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a HTTP/1.1 Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:28:51.557351 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:28:51.560407 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': '9ae98859-f32e-4f5b-b796-a330a860f02a'} Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:28:51.561582 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:28:51.563860 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:28:51.566464 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:28:51.566464 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-02eb0822-2d8a-4f33-b381-29f685366580 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 404 len: 111 microversion: 2.1 time: 0.032624 Aug 26 06:28:51.566464 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 622/1237] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:51 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:28:51.568008 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-413b4a88-151d-487d-ae90-8abfc5e4213d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '.version_select at 0x7f2f08e84c10>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:51.718422 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-413b4a88-151d-487d-ae90-8abfc5e4213d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730155146" status: 202 len: 0 microversion: 2.1 time: 0.154275 Aug 26 06:28:51.719034 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 616/1238] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Aug 26 06:28:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730155146 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:28:52.701215 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e106b960-46d4-422c-a8bc-909dcc992882 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: .version_select at 0x7f2f08f9e820>, body: {"keypair": {"name": "tempest-keypair-811590092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtCsUzWY+a0nMSSsm1tqLXTvZ5GVkLmiHey5AUPywyJjtdQNY+gnk+s/PmNLi8EEE0h1k4PIpiqgbfYA7FB25jag9TGiKMNIdbRkJuAmp5ltXkfwC22Wv/Th2W4jdvAXw=="}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:52.718647 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-e106b960-46d4-422c-a8bc-909dcc992882 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for project c070cba92de641518c86248b1e27daea. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:28:52.722545 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-e106b960-46d4-422c-a8bc-909dcc992882 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for user 38f279301f8c4c76945d361f19b686ac and project c070cba92de641518c86248b1e27daea. Resources: {'key_pairs'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:28:52.811436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e106b960-46d4-422c-a8bc-909dcc992882 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.114153 Aug 26 06:28:52.812027 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 623/1239] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 06:28:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:28:56.462330 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2112160101", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e056da4a-201b-49f0-b8fe-7e84ff97ec06"}], "security_groups": [{"name": "tempest-securitygroup--1152341134"}], "key_name": "tempest-keypair-811590092", "user_data": "}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:28:56.579770 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.network.neutron [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] validate_networks() for [('e056da4a-201b-49f0-b8fe-7e84ff97ec06', None, None, None, None, None)] {{(pid=121344) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:28:57.089746 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Flavor limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:28:57.090181 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Image limits 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:28:57.090720 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Flavor pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:28:57.091168 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Image pref 0:0:0 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:28:57.091583 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.virt.hardware [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121344) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:28:57.100790 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:57.101312 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:57.101750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:57.103096 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:28:57.103557 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:28:57.103991 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:28:57.123906 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for project c070cba92de641518c86248b1e27daea. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:28:57.177700 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for user 38f279301f8c4c76945d361f19b686ac and project c070cba92de641518c86248b1e27daea. Resources: {'cores', 'instances', 'ram'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:28:57.177700 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Going to run 1 instances... {{(pid=121344) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:28:57.177700 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121344) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:28:58.120262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8ad634c9-6aaa-4a59-955c-dc162603e792 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.514711 Aug 26 06:28:58.120262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 617/1240] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:28:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:28:58.122198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c3f8b906-ea43-437b-9e4e-18ecc215fcf6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:58.122198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c3f8b906-ea43-437b-9e4e-18ecc215fcf6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:58.122198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c3f8b906-ea43-437b-9e4e-18ecc215fcf6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:58.122198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c3f8b906-ea43-437b-9e4e-18ecc215fcf6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1241 microversion: 2.1 time: 0.077039 Aug 26 06:28:58.123700 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 624/1241] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:57 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:28:59.080518 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2a6287a5-33ee-4d9e-a6b6-e5cd7efbdc61 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:28:59.081047 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2a6287a5-33ee-4d9e-a6b6-e5cd7efbdc61 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:28:59.135840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-2a6287a5-33ee-4d9e-a6b6-e5cd7efbdc61 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:28:59.142751 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2a6287a5-33ee-4d9e-a6b6-e5cd7efbdc61 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1241 microversion: 2.1 time: 0.066641 Aug 26 06:28:59.143289 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 618/1242] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:28:59 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:00.168266 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0ce0fe70-661f-40f2-9245-7ef2ff2208c9 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:00.168926 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-0ce0fe70-661f-40f2-9245-7ef2ff2208c9 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:00.175612 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe70-661f-40f2-9245-7ef2ff2208c9 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:00.176086 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe70-661f-40f2-9245-7ef2ff2208c9 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:00.176511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe70-661f-40f2-9245-7ef2ff2208c9 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:00.177209 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe70-661f-40f2-9245-7ef2ff2208c9 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:00.177653 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe70-661f-40f2-9245-7ef2ff2208c9 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:00.178363 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe70-661f-40f2-9245-7ef2ff2208c9 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:00.243332 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-0ce0fe70-661f-40f2-9245-7ef2ff2208c9 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:00.251719 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0ce0fe70-661f-40f2-9245-7ef2ff2208c9 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1237 microversion: 2.1 time: 0.088455 Aug 26 06:29:00.252371 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 625/1243] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:00 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:01.273185 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-75a030f9-3c16-48d0-8f0c-96fc898d9018 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:01.274583 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-75a030f9-3c16-48d0-8f0c-96fc898d9018 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:01.281918 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75a030f9-3c16-48d0-8f0c-96fc898d9018 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:01.282408 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75a030f9-3c16-48d0-8f0c-96fc898d9018 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:01.282885 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75a030f9-3c16-48d0-8f0c-96fc898d9018 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:01.283982 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75a030f9-3c16-48d0-8f0c-96fc898d9018 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:01.284262 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75a030f9-3c16-48d0-8f0c-96fc898d9018 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:01.284747 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-75a030f9-3c16-48d0-8f0c-96fc898d9018 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:01.364457 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-75a030f9-3c16-48d0-8f0c-96fc898d9018 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:01.377287 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-75a030f9-3c16-48d0-8f0c-96fc898d9018 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1301 microversion: 2.1 time: 0.107773 Aug 26 06:29:01.378244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 619/1244] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:01 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1301 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:02.399675 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-056a4adb-1259-4617-8049-a87b36fb8b1e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:02.400333 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-056a4adb-1259-4617-8049-a87b36fb8b1e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:02.406559 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-056a4adb-1259-4617-8049-a87b36fb8b1e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:02.407075 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-056a4adb-1259-4617-8049-a87b36fb8b1e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:02.407516 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-056a4adb-1259-4617-8049-a87b36fb8b1e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:02.408212 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-056a4adb-1259-4617-8049-a87b36fb8b1e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:02.408666 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-056a4adb-1259-4617-8049-a87b36fb8b1e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:02.409089 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-056a4adb-1259-4617-8049-a87b36fb8b1e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:02.554891 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-056a4adb-1259-4617-8049-a87b36fb8b1e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:02.568858 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-056a4adb-1259-4617-8049-a87b36fb8b1e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1367 microversion: 2.1 time: 0.173093 Aug 26 06:29:02.569482 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 626/1245] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:02 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:03.165207 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-c137670c-c061-48b8-a4e8-e60257342706 req-3d532feb-9e0b-449a-8459-cf05ee3a5f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1", "tag": "b8d384e8-2d12-442c-83f5-7f066f83d907"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:29:03.175144 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c137670c-c061-48b8-a4e8-e60257342706 req-3d532feb-9e0b-449a-8459-cf05ee3a5f6c service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:03.175617 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c137670c-c061-48b8-a4e8-e60257342706 req-3d532feb-9e0b-449a-8459-cf05ee3a5f6c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:03.176077 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-c137670c-c061-48b8-a4e8-e60257342706 req-3d532feb-9e0b-449a-8459-cf05ee3a5f6c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:03.187809 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-c137670c-c061-48b8-a4e8-e60257342706 req-3d532feb-9e0b-449a-8459-cf05ee3a5f6c service nova] Creating event network-changed:b8d384e8-2d12-442c-83f5-7f066f83d907 for instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 on hv-cinder-85391 Aug 26 06:29:03.193023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-c137670c-c061-48b8-a4e8-e60257342706 req-3d532feb-9e0b-449a-8459-cf05ee3a5f6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031708 Aug 26 06:29:03.193687 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 620/1246] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:29:03.599802 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f35ccd95-87d6-4c59-accd-690095c0d321 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:03.600414 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f35ccd95-87d6-4c59-accd-690095c0d321 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:03.607712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f35ccd95-87d6-4c59-accd-690095c0d321 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:03.608199 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f35ccd95-87d6-4c59-accd-690095c0d321 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:03.608638 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f35ccd95-87d6-4c59-accd-690095c0d321 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:03.609340 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f35ccd95-87d6-4c59-accd-690095c0d321 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:03.609786 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f35ccd95-87d6-4c59-accd-690095c0d321 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:03.610211 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f35ccd95-87d6-4c59-accd-690095c0d321 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:03.751276 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f35ccd95-87d6-4c59-accd-690095c0d321 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:03.759656 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f35ccd95-87d6-4c59-accd-690095c0d321 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1367 microversion: 2.1 time: 0.163634 Aug 26 06:29:03.760233 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 627/1247] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:03 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:04.782332 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8cf19765-1f68-4cbb-8950-fb469326ed82 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:04.783060 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8cf19765-1f68-4cbb-8950-fb469326ed82 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:04.789285 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cf19765-1f68-4cbb-8950-fb469326ed82 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:04.790516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cf19765-1f68-4cbb-8950-fb469326ed82 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:04.790990 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cf19765-1f68-4cbb-8950-fb469326ed82 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:04.791686 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cf19765-1f68-4cbb-8950-fb469326ed82 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:04.792152 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cf19765-1f68-4cbb-8950-fb469326ed82 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:04.792565 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8cf19765-1f68-4cbb-8950-fb469326ed82 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:04.927805 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8cf19765-1f68-4cbb-8950-fb469326ed82 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:04.936261 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8cf19765-1f68-4cbb-8950-fb469326ed82 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1367 microversion: 2.1 time: 0.158719 Aug 26 06:29:04.936850 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 621/1248] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:04 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:05.957284 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-74ef5010-d3f2-4283-ad9e-040d454c9dfb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:05.962649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-74ef5010-d3f2-4283-ad9e-040d454c9dfb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:05.966560 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-74ef5010-d3f2-4283-ad9e-040d454c9dfb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:05.967182 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-74ef5010-d3f2-4283-ad9e-040d454c9dfb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:05.967621 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-74ef5010-d3f2-4283-ad9e-040d454c9dfb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:05.968324 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-74ef5010-d3f2-4283-ad9e-040d454c9dfb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:05.968776 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-74ef5010-d3f2-4283-ad9e-040d454c9dfb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:05.969198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-74ef5010-d3f2-4283-ad9e-040d454c9dfb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:05.972212 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=79 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:29:06.107273 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-74ef5010-d3f2-4283-ad9e-040d454c9dfb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:06.115725 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-74ef5010-d3f2-4283-ad9e-040d454c9dfb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1367 microversion: 2.1 time: 0.162185 Aug 26 06:29:06.116289 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 628/1249] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:05 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:07.137971 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-8236674e-26b4-4c35-9c90-8fa4f4e02f63 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:07.138647 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-8236674e-26b4-4c35-9c90-8fa4f4e02f63 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:07.141130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:29:07.141787 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:29:07.146882 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8236674e-26b4-4c35-9c90-8fa4f4e02f63 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:07.147359 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8236674e-26b4-4c35-9c90-8fa4f4e02f63 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:07.147785 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8236674e-26b4-4c35-9c90-8fa4f4e02f63 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:07.148476 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8236674e-26b4-4c35-9c90-8fa4f4e02f63 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:07.148964 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8236674e-26b4-4c35-9c90-8fa4f4e02f63 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:07.155193 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-8236674e-26b4-4c35-9c90-8fa4f4e02f63 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:07.155193 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:29:07.291798 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-8236674e-26b4-4c35-9c90-8fa4f4e02f63 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:07.299345 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-8236674e-26b4-4c35-9c90-8fa4f4e02f63 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1367 microversion: 2.1 time: 0.165915 Aug 26 06:29:07.299905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 622/1250] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:07 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:08.322965 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e27c04bd-2b98-4aca-b47f-7747e1f7c112 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:08.323749 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e27c04bd-2b98-4aca-b47f-7747e1f7c112 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:08.326128 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=6 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:29:08.326808 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:29:08.331758 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e27c04bd-2b98-4aca-b47f-7747e1f7c112 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:08.332234 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e27c04bd-2b98-4aca-b47f-7747e1f7c112 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:08.332768 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e27c04bd-2b98-4aca-b47f-7747e1f7c112 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:08.333383 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e27c04bd-2b98-4aca-b47f-7747e1f7c112 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:08.333801 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e27c04bd-2b98-4aca-b47f-7747e1f7c112 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:08.334395 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e27c04bd-2b98-4aca-b47f-7747e1f7c112 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:08.470146 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e27c04bd-2b98-4aca-b47f-7747e1f7c112 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:08.478390 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e27c04bd-2b98-4aca-b47f-7747e1f7c112 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1367 microversion: 2.1 time: 0.160558 Aug 26 06:29:08.479001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 629/1251] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:08 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:09.499801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-72a0477b-29c7-4f30-940b-7bddcbeeda86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:09.504814 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-72a0477b-29c7-4f30-940b-7bddcbeeda86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:09.504814 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=8 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:29:09.509211 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a0477b-29c7-4f30-940b-7bddcbeeda86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:09.509698 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a0477b-29c7-4f30-940b-7bddcbeeda86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:09.510138 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a0477b-29c7-4f30-940b-7bddcbeeda86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:09.511016 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a0477b-29c7-4f30-940b-7bddcbeeda86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:09.511840 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a0477b-29c7-4f30-940b-7bddcbeeda86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:09.513147 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-72a0477b-29c7-4f30-940b-7bddcbeeda86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:09.645469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-72a0477b-29c7-4f30-940b-7bddcbeeda86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:09.656307 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-72a0477b-29c7-4f30-940b-7bddcbeeda86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1367 microversion: 2.1 time: 0.160420 Aug 26 06:29:09.656895 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 623/1252] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:09 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:29:10.232116 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-67d8827b-765c-44be-97cb-b7c25340137d req-fbdcd876-5f12-4032-a95d-cca41c90cc4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1", "name": "network-vif-plugged", "status": "completed", "tag": "b8d384e8-2d12-442c-83f5-7f066f83d907"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:29:10.243092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-67d8827b-765c-44be-97cb-b7c25340137d req-fbdcd876-5f12-4032-a95d-cca41c90cc4c service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:10.243568 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-67d8827b-765c-44be-97cb-b7c25340137d req-fbdcd876-5f12-4032-a95d-cca41c90cc4c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:10.243991 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-67d8827b-765c-44be-97cb-b7c25340137d req-fbdcd876-5f12-4032-a95d-cca41c90cc4c service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:10.254844 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-67d8827b-765c-44be-97cb-b7c25340137d req-fbdcd876-5f12-4032-a95d-cca41c90cc4c service nova] Creating event network-vif-plugged:b8d384e8-2d12-442c-83f5-7f066f83d907 for instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 on hv-cinder-85391 Aug 26 06:29:10.260489 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-67d8827b-765c-44be-97cb-b7c25340137d req-fbdcd876-5f12-4032-a95d-cca41c90cc4c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032459 Aug 26 06:29:10.261069 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 630/1253] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:29:10.677277 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e84c3184-4f92-46fb-b9b8-7fa141a91857 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:10.678019 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e84c3184-4f92-46fb-b9b8-7fa141a91857 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:10.687460 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e84c3184-4f92-46fb-b9b8-7fa141a91857 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:10.687949 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e84c3184-4f92-46fb-b9b8-7fa141a91857 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:10.688384 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e84c3184-4f92-46fb-b9b8-7fa141a91857 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:10.689235 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e84c3184-4f92-46fb-b9b8-7fa141a91857 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:10.689697 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e84c3184-4f92-46fb-b9b8-7fa141a91857 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:10.690475 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e84c3184-4f92-46fb-b9b8-7fa141a91857 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:10.854341 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-e84c3184-4f92-46fb-b9b8-7fa141a91857 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:10.861942 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e84c3184-4f92-46fb-b9b8-7fa141a91857 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1367 microversion: 2.1 time: 0.188573 Aug 26 06:29:10.862500 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 624/1254] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:10 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:11.883980 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f64abdee-0c3c-4df2-a961-67d2320c0ad5 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:11.884681 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f64abdee-0c3c-4df2-a961-67d2320c0ad5 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:11.890978 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f64abdee-0c3c-4df2-a961-67d2320c0ad5 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:11.891463 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f64abdee-0c3c-4df2-a961-67d2320c0ad5 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:11.891895 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f64abdee-0c3c-4df2-a961-67d2320c0ad5 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:11.892592 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f64abdee-0c3c-4df2-a961-67d2320c0ad5 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:11.893046 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f64abdee-0c3c-4df2-a961-67d2320c0ad5 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:11.893468 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f64abdee-0c3c-4df2-a961-67d2320c0ad5 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:12.026774 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-f64abdee-0c3c-4df2-a961-67d2320c0ad5 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:12.034416 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f64abdee-0c3c-4df2-a961-67d2320c0ad5 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1367 microversion: 2.1 time: 0.155638 Aug 26 06:29:12.035002 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 631/1255] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:11 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:13.058853 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dfc83d41-0324-4611-835d-ec9f610bf878 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:13.059484 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-dfc83d41-0324-4611-835d-ec9f610bf878 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:13.066255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfc83d41-0324-4611-835d-ec9f610bf878 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:13.066770 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfc83d41-0324-4611-835d-ec9f610bf878 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:13.067201 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfc83d41-0324-4611-835d-ec9f610bf878 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:13.067886 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfc83d41-0324-4611-835d-ec9f610bf878 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:13.068405 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfc83d41-0324-4611-835d-ec9f610bf878 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:13.068827 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dfc83d41-0324-4611-835d-ec9f610bf878 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:13.201309 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-dfc83d41-0324-4611-835d-ec9f610bf878 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:29:13.209409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-dfc83d41-0324-4611-835d-ec9f610bf878 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1557 microversion: 2.1 time: 0.155231 Aug 26 06:29:13.209965 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 625/1256] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:29:13 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:29:13.229845 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-d00deb7b-4091-426a-b0f9-e8b09f9d197c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:13.230404 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-d00deb7b-4091-426a-b0f9-e8b09f9d197c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:13.236780 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d00deb7b-4091-426a-b0f9-e8b09f9d197c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:13.237317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d00deb7b-4091-426a-b0f9-e8b09f9d197c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:13.237747 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d00deb7b-4091-426a-b0f9-e8b09f9d197c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:13.238428 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d00deb7b-4091-426a-b0f9-e8b09f9d197c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:13.238910 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d00deb7b-4091-426a-b0f9-e8b09f9d197c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:13.239510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-d00deb7b-4091-426a-b0f9-e8b09f9d197c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:13.325358 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-d00deb7b-4091-426a-b0f9-e8b09f9d197c tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099687 Aug 26 06:29:13.325976 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 632/1257] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 06:29:13 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:29:14.416323 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-a31976e9-bb15-491d-a665-9a2fdf3c05fc req-2305a385-2206-4d2d-88c1-7601f193b4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1", "tag": "b8d384e8-2d12-442c-83f5-7f066f83d907"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:29:14.427022 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a31976e9-bb15-491d-a665-9a2fdf3c05fc req-2305a385-2206-4d2d-88c1-7601f193b4f5 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:14.427510 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a31976e9-bb15-491d-a665-9a2fdf3c05fc req-2305a385-2206-4d2d-88c1-7601f193b4f5 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:14.428029 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a31976e9-bb15-491d-a665-9a2fdf3c05fc req-2305a385-2206-4d2d-88c1-7601f193b4f5 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:14.439750 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-a31976e9-bb15-491d-a665-9a2fdf3c05fc req-2305a385-2206-4d2d-88c1-7601f193b4f5 service nova] Creating event network-changed:b8d384e8-2d12-442c-83f5-7f066f83d907 for instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 on hv-cinder-85391 Aug 26 06:29:14.444858 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-a31976e9-bb15-491d-a665-9a2fdf3c05fc req-2305a385-2206-4d2d-88c1-7601f193b4f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032297 Aug 26 06:29:14.445409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 626/1258] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:29:50.719719 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=7 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:29:50.720492 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=23 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:29:50.724498 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-31c5f25f-fd87-440f-b5c1-79c378a6b119 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:29:50.724993 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-31c5f25f-fd87-440f-b5c1-79c378a6b119 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:50.731709 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-31c5f25f-fd87-440f-b5c1-79c378a6b119 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:50.732198 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-31c5f25f-fd87-440f-b5c1-79c378a6b119 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:50.732635 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-31c5f25f-fd87-440f-b5c1-79c378a6b119 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:50.733340 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-31c5f25f-fd87-440f-b5c1-79c378a6b119 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:50.733796 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-31c5f25f-fd87-440f-b5c1-79c378a6b119 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:50.734221 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-31c5f25f-fd87-440f-b5c1-79c378a6b119 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:50.759943 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-31c5f25f-fd87-440f-b5c1-79c378a6b119 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/ips" status: 200 len: 149 microversion: 2.1 time: 0.041739 Aug 26 06:29:50.760532 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 633/1259] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 06:29:50 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:29:52.861131 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=9 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:29:52.861976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=25 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:29:52.866388 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-6a9f8527-a847-42e1-9ec1-4c23623b0c8e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fda146fa-88eb-4fa9-b909-d03c14dcd9fe"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:29:52.868941 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-6a9f8527-a847-42e1-9ec1-4c23623b0c8e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:29:52.877290 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a9f8527-a847-42e1-9ec1-4c23623b0c8e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:52.878066 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a9f8527-a847-42e1-9ec1-4c23623b0c8e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:52.878862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a9f8527-a847-42e1-9ec1-4c23623b0c8e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:52.879987 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a9f8527-a847-42e1-9ec1-4c23623b0c8e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:29:52.880747 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a9f8527-a847-42e1-9ec1-4c23623b0c8e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:29:52.881438 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-6a9f8527-a847-42e1-9ec1-4c23623b0c8e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:29:54.446489 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-6a9f8527-a847-42e1-9ec1-4c23623b0c8e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.586971 Aug 26 06:29:54.447245 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 627/1260] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:29:52 2022] POST /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments => generated 194 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:30:03.084763 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fda146fa-88eb-4fa9-b909-d03c14dcd9fe"}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:30:03.087712 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:03.095482 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:03.096484 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:03.096484 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:03.097098 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:03.097552 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:03.097977 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:03.187261 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Invalid volume: volume fda146fa-88eb-4fa9-b909-d03c14dcd9fe is already attached to instances: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: POST /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments HTTP/1.1 Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 74 Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:30:03.189017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {"volumeAttachment": {"volumeId": "fda146fa-88eb-4fa9-b909-d03c14dcd9fe"}} Aug 26 06:30:03.191061 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Invalid volume: volume fda146fa-88eb-4fa9-b909-d03c14dcd9fe is already attached to instances: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'server_id': 'b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1', 'body': {'volumeAttachment': {'volumeId': 'fda146fa-88eb-4fa9-b909-d03c14dcd9fe'}}} Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fda146fa-88eb-4fa9-b909-d03c14dcd9fe is already attached to instances: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:30:03.192062 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fda146fa-88eb-4fa9-b909-d03c14dcd9fe is already attached to instances: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:30:03.194381 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:30:03.196305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:30:03.196305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:30:03.196305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:30:03.196305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fda146fa-88eb-4fa9-b909-d03c14dcd9fe is already attached to instances: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 Aug 26 06:30:03.196305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:30:03.196305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 400 to user: Invalid volume: volume fda146fa-88eb-4fa9-b909-d03c14dcd9fe is already attached to instances: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:30:03.196305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ca51c69b-b0be-486a-9d46-bbda7c72fbbb tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110222 Aug 26 06:30:03.196305 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 634/1261] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:30:03 2022] POST /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 06:30:03.265008 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5cf250a7-e7e2-4560-a539-476710023a92 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:03.265747 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5cf250a7-e7e2-4560-a539-476710023a92 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:03.272040 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5cf250a7-e7e2-4560-a539-476710023a92 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:03.273337 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5cf250a7-e7e2-4560-a539-476710023a92 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:03.274007 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5cf250a7-e7e2-4560-a539-476710023a92 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:03.274739 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5cf250a7-e7e2-4560-a539-476710023a92 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:03.275191 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5cf250a7-e7e2-4560-a539-476710023a92 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:03.275616 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5cf250a7-e7e2-4560-a539-476710023a92 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:03.358716 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.objects.instance [None req-5cf250a7-e7e2-4560-a539-476710023a92 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lazy-loading 'services' on Instance uuid b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 {{(pid=121344) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:30:03.818366 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5cf250a7-e7e2-4560-a539-476710023a92 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments/fda146fa-88eb-4fa9-b909-d03c14dcd9fe" status: 202 len: 0 microversion: 2.1 time: 0.557901 Aug 26 06:30:03.818997 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 628/1262] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:30:03 2022] DELETE /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments/fda146fa-88eb-4fa9-b909-d03c14dcd9fe => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:30:03.828314 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6561be46-9256-4e83-8ce5-ef4aae7e5141 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:03.830482 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6561be46-9256-4e83-8ce5-ef4aae7e5141 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:03.836823 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6561be46-9256-4e83-8ce5-ef4aae7e5141 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:03.837302 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6561be46-9256-4e83-8ce5-ef4aae7e5141 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:03.837738 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6561be46-9256-4e83-8ce5-ef4aae7e5141 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:03.838433 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6561be46-9256-4e83-8ce5-ef4aae7e5141 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:03.838917 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6561be46-9256-4e83-8ce5-ef4aae7e5141 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:03.839343 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6561be46-9256-4e83-8ce5-ef4aae7e5141 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:03.882604 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6561be46-9256-4e83-8ce5-ef4aae7e5141 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054095 Aug 26 06:30:03.882604 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 635/1263] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:30:03 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:30:04.894520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-03e78f5b-41ef-4234-a8f2-955797fb89ac tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:04.896814 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-03e78f5b-41ef-4234-a8f2-955797fb89ac tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:04.903016 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03e78f5b-41ef-4234-a8f2-955797fb89ac tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:04.903490 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03e78f5b-41ef-4234-a8f2-955797fb89ac tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:04.903924 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03e78f5b-41ef-4234-a8f2-955797fb89ac tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:04.904608 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03e78f5b-41ef-4234-a8f2-955797fb89ac tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:04.905055 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03e78f5b-41ef-4234-a8f2-955797fb89ac tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:04.905474 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-03e78f5b-41ef-4234-a8f2-955797fb89ac tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:04.938385 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-03e78f5b-41ef-4234-a8f2-955797fb89ac tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048677 Aug 26 06:30:04.938996 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 629/1264] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:30:04 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:30:05.951280 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-8cf4c9cd-8c8f-4d12-b19a-1c1d0bf31db2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:05.953436 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-8cf4c9cd-8c8f-4d12-b19a-1c1d0bf31db2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:05.961204 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8cf4c9cd-8c8f-4d12-b19a-1c1d0bf31db2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:05.961691 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8cf4c9cd-8c8f-4d12-b19a-1c1d0bf31db2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:05.962124 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8cf4c9cd-8c8f-4d12-b19a-1c1d0bf31db2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:05.962851 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8cf4c9cd-8c8f-4d12-b19a-1c1d0bf31db2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:05.963299 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8cf4c9cd-8c8f-4d12-b19a-1c1d0bf31db2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:05.963723 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-8cf4c9cd-8c8f-4d12-b19a-1c1d0bf31db2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:05.992889 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-8cf4c9cd-8c8f-4d12-b19a-1c1d0bf31db2 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045551 Aug 26 06:30:05.993429 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 636/1265] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:30:05 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 06:30:06.054969 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0a4610ac-41f3-4266-9bd1-0433a6d5ab01 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:06.055494 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0a4610ac-41f3-4266-9bd1-0433a6d5ab01 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:06.061861 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0a4610ac-41f3-4266-9bd1-0433a6d5ab01 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:06.062338 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0a4610ac-41f3-4266-9bd1-0433a6d5ab01 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:06.062813 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0a4610ac-41f3-4266-9bd1-0433a6d5ab01 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:06.063494 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0a4610ac-41f3-4266-9bd1-0433a6d5ab01 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:06.063945 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0a4610ac-41f3-4266-9bd1-0433a6d5ab01 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:06.064371 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0a4610ac-41f3-4266-9bd1-0433a6d5ab01 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:06.089830 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0a4610ac-41f3-4266-9bd1-0433a6d5ab01 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:30:06.728786 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0a4610ac-41f3-4266-9bd1-0433a6d5ab01 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 204 len: 0 microversion: 2.1 time: 0.678022 Aug 26 06:30:06.729482 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 630/1266] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:30:06 2022] DELETE /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:30:06.739036 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6f75b80d-97ed-49cd-b57c-60a91db591b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:06.739670 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6f75b80d-97ed-49cd-b57c-60a91db591b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:06.746201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f75b80d-97ed-49cd-b57c-60a91db591b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:06.746796 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f75b80d-97ed-49cd-b57c-60a91db591b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:06.747306 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f75b80d-97ed-49cd-b57c-60a91db591b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:06.748186 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f75b80d-97ed-49cd-b57c-60a91db591b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:06.748747 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f75b80d-97ed-49cd-b57c-60a91db591b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:06.749233 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-6f75b80d-97ed-49cd-b57c-60a91db591b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:06.889258 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6f75b80d-97ed-49cd-b57c-60a91db591b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:06.897930 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6f75b80d-97ed-49cd-b57c-60a91db591b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1681 microversion: 2.1 time: 0.163115 Aug 26 06:30:06.898510 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 637/1267] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:06 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:07.920801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f98bd9f2-1b21-4516-ba08-16a35e584139 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:07.921494 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f98bd9f2-1b21-4516-ba08-16a35e584139 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:07.928243 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98bd9f2-1b21-4516-ba08-16a35e584139 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:07.929662 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98bd9f2-1b21-4516-ba08-16a35e584139 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:07.930189 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98bd9f2-1b21-4516-ba08-16a35e584139 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:07.930925 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98bd9f2-1b21-4516-ba08-16a35e584139 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:07.931405 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98bd9f2-1b21-4516-ba08-16a35e584139 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:07.931874 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f98bd9f2-1b21-4516-ba08-16a35e584139 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:08.065550 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f98bd9f2-1b21-4516-ba08-16a35e584139 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:08.073861 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f98bd9f2-1b21-4516-ba08-16a35e584139 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1681 microversion: 2.1 time: 0.157254 Aug 26 06:30:08.074421 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 631/1268] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:07 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:09.095059 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-592cf615-a6cf-4d3c-82cc-9b6765987a8f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:09.095673 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-592cf615-a6cf-4d3c-82cc-9b6765987a8f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:09.102558 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-592cf615-a6cf-4d3c-82cc-9b6765987a8f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:09.103097 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-592cf615-a6cf-4d3c-82cc-9b6765987a8f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:09.103569 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-592cf615-a6cf-4d3c-82cc-9b6765987a8f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:09.104266 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-592cf615-a6cf-4d3c-82cc-9b6765987a8f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:09.104716 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-592cf615-a6cf-4d3c-82cc-9b6765987a8f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:09.105141 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-592cf615-a6cf-4d3c-82cc-9b6765987a8f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:09.241572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-592cf615-a6cf-4d3c-82cc-9b6765987a8f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:09.248098 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-592cf615-a6cf-4d3c-82cc-9b6765987a8f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1681 microversion: 2.1 time: 0.157187 Aug 26 06:30:09.248672 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 638/1269] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:09 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:09.476258 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-03edd2e8-b50b-479b-89e1-55d2a5857914 req-21ffc457-bf7f-4303-9ea8-c166415f4180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1", "name": "network-vif-deleted", "tag": "b8d384e8-2d12-442c-83f5-7f066f83d907"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:30:09.487535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-03edd2e8-b50b-479b-89e1-55d2a5857914 req-21ffc457-bf7f-4303-9ea8-c166415f4180 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:09.488004 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-03edd2e8-b50b-479b-89e1-55d2a5857914 req-21ffc457-bf7f-4303-9ea8-c166415f4180 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:09.488429 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-03edd2e8-b50b-479b-89e1-55d2a5857914 req-21ffc457-bf7f-4303-9ea8-c166415f4180 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:09.500672 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-03edd2e8-b50b-479b-89e1-55d2a5857914 req-21ffc457-bf7f-4303-9ea8-c166415f4180 service nova] Creating event network-vif-deleted:b8d384e8-2d12-442c-83f5-7f066f83d907 for instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 on hv-cinder-85391 Aug 26 06:30:09.505604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-03edd2e8-b50b-479b-89e1-55d2a5857914 req-21ffc457-bf7f-4303-9ea8-c166415f4180 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035557 Aug 26 06:30:09.506179 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 632/1270] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:30:10.269536 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:10.270962 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:10.279186 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:10.279715 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:10.280151 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:10.280845 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:10.281292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:10.281711 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:10.316838 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:10.317322 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:10.317751 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:10.318194 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lazy-loading 'fault' on Instance uuid b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:30:10.364586 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:10.373401 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b82f5732-dd4b-4f6b-ac19-1ac04bbc2d57 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 200 len: 1331 microversion: 2.1 time: 0.107899 Aug 26 06:30:10.373959 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 639/1271] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:10 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:11.398026 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:11.398761 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:11.405130 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:11.405613 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:11.406049 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:11.406769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:11.407222 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:11.407648 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:11.423851 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 HTTP/1.1 Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:30:11.425481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:30:11.427282 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1'} Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:30:11.428467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:30:11.430499 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:30:11.432383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:30:11.432383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c7f6e87e-445e-42ed-86eb-5940e6263039 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 404 len: 111 microversion: 2.1 time: 0.034018 Aug 26 06:30:11.432383 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 633/1272] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:11 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:30:11.436215 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-0842cc41-b289-4baf-ac3a-ee74d6c7c467 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '.version_select at 0x7f2f0918c280>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:11.575317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-0842cc41-b289-4baf-ac3a-ee74d6c7c467 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811590092" status: 202 len: 0 microversion: 2.1 time: 0.142795 Aug 26 06:30:11.575957 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 640/1273] 10.222.0.40 () {58 vars in 1218 bytes} [Fri Aug 26 06:30:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811590092 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 06:30:12.626219 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f31632bb-f067-43da-bd64-9641f3a98710 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: .version_select at 0x7f2f08db1700>, body: {"keypair": {"name": "tempest-keypair-1084809159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItCVtFLuNpbuhzXAjpxPv2qahlEBCYiqBc+vZ0KedLkrYR649mvzZ4/g5RyL+5e/BiJ8SWnIDMGLyzYrOxwRCH13cJrcm+EtP7pQPQpqzCIOoMfjV9LPj9JEolLwqVLXg=="}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:30:12.643150 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-f31632bb-f067-43da-bd64-9641f3a98710 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for project c070cba92de641518c86248b1e27daea. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:30:12.647455 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.quota [None req-f31632bb-f067-43da-bd64-9641f3a98710 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for user 38f279301f8c4c76945d361f19b686ac and project c070cba92de641518c86248b1e27daea. Resources: {'key_pairs'} {{(pid=121344) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:30:12.786409 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f31632bb-f067-43da-bd64-9641f3a98710 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163910 Aug 26 06:30:12.786960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 634/1274] 10.222.0.40 () {60 vars in 1159 bytes} [Fri Aug 26 06:30:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:30:15.942023 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 06:30:15.942501 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Fri Aug 26 06:30:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.40) !!! Aug 26 06:30:15.947139 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1121764586", "imageRef": "00008ac1-78ee-485b-9e67-b90be0cf0320", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e056da4a-201b-49f0-b8fe-7e84ff97ec06"}], "security_groups": [{"name": "tempest-securitygroup--1172676454"}], "key_name": "tempest-keypair-1084809159", "user_data": "}} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:30:16.170920 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.network.neutron [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] validate_networks() for [('e056da4a-201b-49f0-b8fe-7e84ff97ec06', None, None, None, None, None)] {{(pid=121343) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 06:30:16.479111 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Flavor limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 06:30:16.479527 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Image limits 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 06:30:16.479996 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Flavor pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 06:30:16.480394 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Image pref 0:0:0 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 06:30:16.480841 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.virt.hardware [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121343) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 06:30:16.489918 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:16.490330 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:16.490845 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:16.492170 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:16.492618 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:16.493039 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:16.511959 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for project c070cba92de641518c86248b1e27daea. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 06:30:16.515886 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.quota [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Getting quotas for user 38f279301f8c4c76945d361f19b686ac and project c070cba92de641518c86248b1e27daea. Resources: {'cores', 'instances', 'ram'} {{(pid=121343) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 06:30:16.528490 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Going to run 1 instances... {{(pid=121343) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 06:30:16.530826 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='00008ac1-78ee-485b-9e67-b90be0cf0320',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121343) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 06:30:16.719400 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b0befd41-abb4-4eab-a125-431474b65dd6 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779051 Aug 26 06:30:16.720046 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 641/1275] 10.222.0.40 () {60 vars in 1147 bytes} [Fri Aug 26 06:30:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 06:30:16.733052 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-da6c8d62-69c0-4bf7-87ae-8d6b4407f829 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:16.734418 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-da6c8d62-69c0-4bf7-87ae-8d6b4407f829 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:16.791232 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-da6c8d62-69c0-4bf7-87ae-8d6b4407f829 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:16.798227 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-da6c8d62-69c0-4bf7-87ae-8d6b4407f829 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1242 microversion: 2.1 time: 0.070143 Aug 26 06:30:16.798819 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 635/1276] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:16 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:17.820968 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-6ca10e38-62eb-4b2f-87ee-d3aca005097a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:17.821580 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-6ca10e38-62eb-4b2f-87ee-d3aca005097a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:17.875311 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-6ca10e38-62eb-4b2f-87ee-d3aca005097a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:17.883533 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-6ca10e38-62eb-4b2f-87ee-d3aca005097a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1242 microversion: 2.1 time: 0.067032 Aug 26 06:30:17.884085 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 642/1277] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:17 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:18.904847 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-c6e043fc-89a8-4e7e-8275-9fd9b5045433 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:18.905467 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-c6e043fc-89a8-4e7e-8275-9fd9b5045433 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:18.912063 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6e043fc-89a8-4e7e-8275-9fd9b5045433 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:18.912555 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6e043fc-89a8-4e7e-8275-9fd9b5045433 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:18.913053 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6e043fc-89a8-4e7e-8275-9fd9b5045433 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:18.913948 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6e043fc-89a8-4e7e-8275-9fd9b5045433 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:18.914433 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6e043fc-89a8-4e7e-8275-9fd9b5045433 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:18.914900 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-c6e043fc-89a8-4e7e-8275-9fd9b5045433 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:18.978071 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-c6e043fc-89a8-4e7e-8275-9fd9b5045433 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:18.985912 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-c6e043fc-89a8-4e7e-8275-9fd9b5045433 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1238 microversion: 2.1 time: 0.085109 Aug 26 06:30:18.986473 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 636/1278] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:18 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:20.008705 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5a5e21b2-ac48-4473-a099-ffdea8e7adf0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:20.009325 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5a5e21b2-ac48-4473-a099-ffdea8e7adf0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:20.016100 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5a5e21b2-ac48-4473-a099-ffdea8e7adf0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:20.016586 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5a5e21b2-ac48-4473-a099-ffdea8e7adf0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:20.017028 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5a5e21b2-ac48-4473-a099-ffdea8e7adf0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:20.017730 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5a5e21b2-ac48-4473-a099-ffdea8e7adf0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:20.018187 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5a5e21b2-ac48-4473-a099-ffdea8e7adf0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:20.018632 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5a5e21b2-ac48-4473-a099-ffdea8e7adf0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:20.088863 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5a5e21b2-ac48-4473-a099-ffdea8e7adf0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:20.099353 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5a5e21b2-ac48-4473-a099-ffdea8e7adf0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1302 microversion: 2.1 time: 0.095734 Aug 26 06:30:20.099944 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 643/1279] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:20 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:21.123953 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ee69b762-f8b1-4e59-ba50-ff54b5f10914 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:21.124677 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ee69b762-f8b1-4e59-ba50-ff54b5f10914 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:21.135117 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee69b762-f8b1-4e59-ba50-ff54b5f10914 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:21.135617 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee69b762-f8b1-4e59-ba50-ff54b5f10914 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:21.136058 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee69b762-f8b1-4e59-ba50-ff54b5f10914 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:21.136856 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee69b762-f8b1-4e59-ba50-ff54b5f10914 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:21.137307 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee69b762-f8b1-4e59-ba50-ff54b5f10914 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:21.137731 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ee69b762-f8b1-4e59-ba50-ff54b5f10914 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:21.389406 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-ee69b762-f8b1-4e59-ba50-ff54b5f10914 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:21.398119 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ee69b762-f8b1-4e59-ba50-ff54b5f10914 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1368 microversion: 2.1 time: 0.277532 Aug 26 06:30:21.398832 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 637/1280] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:21 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:21.990732 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [req-c2d9eff5-e1b9-41f6-b52f-f2fc7a404e80 req-74274beb-fd67-424b-9677-fec93172b8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e40e2d-94dd-457a-8aa3-4810a4c316c8", "tag": "f0fcf348-aeb7-46e5-a86a-c7349af6e732"}]} {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:30:22.002022 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-c2d9eff5-e1b9-41f6-b52f-f2fc7a404e80 req-74274beb-fd67-424b-9677-fec93172b8a6 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:22.002608 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-c2d9eff5-e1b9-41f6-b52f-f2fc7a404e80 req-74274beb-fd67-424b-9677-fec93172b8a6 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:22.002969 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [req-c2d9eff5-e1b9-41f6-b52f-f2fc7a404e80 req-74274beb-fd67-424b-9677-fec93172b8a6 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:22.017441 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.compute.server_external_events [req-c2d9eff5-e1b9-41f6-b52f-f2fc7a404e80 req-74274beb-fd67-424b-9677-fec93172b8a6 service nova] Creating event network-changed:f0fcf348-aeb7-46e5-a86a-c7349af6e732 for instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 on hv-cinder-85391 Aug 26 06:30:22.023649 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [req-c2d9eff5-e1b9-41f6-b52f-f2fc7a404e80 req-74274beb-fd67-424b-9677-fec93172b8a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035622 Aug 26 06:30:22.024680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 644/1281] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:30:22.419201 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-5e57c29f-8068-460d-b5f2-467f6fbe2e86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:22.419810 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-5e57c29f-8068-460d-b5f2-467f6fbe2e86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:22.426760 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e57c29f-8068-460d-b5f2-467f6fbe2e86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:22.427244 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e57c29f-8068-460d-b5f2-467f6fbe2e86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:22.427678 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e57c29f-8068-460d-b5f2-467f6fbe2e86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:22.429760 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e57c29f-8068-460d-b5f2-467f6fbe2e86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:22.430221 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e57c29f-8068-460d-b5f2-467f6fbe2e86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:22.430673 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-5e57c29f-8068-460d-b5f2-467f6fbe2e86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:22.672108 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-5e57c29f-8068-460d-b5f2-467f6fbe2e86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:22.690845 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-5e57c29f-8068-460d-b5f2-467f6fbe2e86 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1368 microversion: 2.1 time: 0.273920 Aug 26 06:30:22.692028 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 638/1282] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:22 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:23.716603 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-cac3edb6-3a45-4a0a-a341-299c6f0de288 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:23.717395 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-cac3edb6-3a45-4a0a-a341-299c6f0de288 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:23.723848 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cac3edb6-3a45-4a0a-a341-299c6f0de288 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:23.733064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cac3edb6-3a45-4a0a-a341-299c6f0de288 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:23.733064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cac3edb6-3a45-4a0a-a341-299c6f0de288 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:23.733064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cac3edb6-3a45-4a0a-a341-299c6f0de288 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:23.733064 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cac3edb6-3a45-4a0a-a341-299c6f0de288 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:23.733556 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-cac3edb6-3a45-4a0a-a341-299c6f0de288 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:23.868685 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-cac3edb6-3a45-4a0a-a341-299c6f0de288 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:23.876901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-cac3edb6-3a45-4a0a-a341-299c6f0de288 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1368 microversion: 2.1 time: 0.165137 Aug 26 06:30:23.877527 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 645/1283] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:23 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:24.899160 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-623ce0d1-2d5b-4dc9-b2ec-3e8dd1181e9d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:24.899801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-623ce0d1-2d5b-4dc9-b2ec-3e8dd1181e9d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:24.902289 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:30:24.907064 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-623ce0d1-2d5b-4dc9-b2ec-3e8dd1181e9d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:24.907593 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-623ce0d1-2d5b-4dc9-b2ec-3e8dd1181e9d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:24.908033 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-623ce0d1-2d5b-4dc9-b2ec-3e8dd1181e9d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:24.908724 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-623ce0d1-2d5b-4dc9-b2ec-3e8dd1181e9d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:24.909177 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-623ce0d1-2d5b-4dc9-b2ec-3e8dd1181e9d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:24.909604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-623ce0d1-2d5b-4dc9-b2ec-3e8dd1181e9d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:24.912394 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:30:25.047314 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-623ce0d1-2d5b-4dc9-b2ec-3e8dd1181e9d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:25.059854 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-623ce0d1-2d5b-4dc9-b2ec-3e8dd1181e9d tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1368 microversion: 2.1 time: 0.165439 Aug 26 06:30:25.060438 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 639/1284] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:24 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:26.082201 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-5534e435-6e02-404b-a765-80e5cd3f4314 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:26.083252 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-5534e435-6e02-404b-a765-80e5cd3f4314 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:26.092179 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5534e435-6e02-404b-a765-80e5cd3f4314 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:26.092686 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5534e435-6e02-404b-a765-80e5cd3f4314 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:26.093133 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5534e435-6e02-404b-a765-80e5cd3f4314 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:26.093855 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5534e435-6e02-404b-a765-80e5cd3f4314 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:26.094317 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5534e435-6e02-404b-a765-80e5cd3f4314 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:26.094777 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-5534e435-6e02-404b-a765-80e5cd3f4314 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:26.251076 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-5534e435-6e02-404b-a765-80e5cd3f4314 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:26.260039 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-5534e435-6e02-404b-a765-80e5cd3f4314 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1368 microversion: 2.1 time: 0.182927 Aug 26 06:30:26.260872 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 646/1285] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:26 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 06:30:27.284400 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-f0602eb0-81e4-4bfc-a302-90173b30bd1a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:27.285076 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-f0602eb0-81e4-4bfc-a302-90173b30bd1a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:27.287834 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell0:SELECT=6 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:30:27.294355 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0602eb0-81e4-4bfc-a302-90173b30bd1a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:27.295038 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0602eb0-81e4-4bfc-a302-90173b30bd1a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:27.295343 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0602eb0-81e4-4bfc-a302-90173b30bd1a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:27.296134 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0602eb0-81e4-4bfc-a302-90173b30bd1a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:27.296638 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0602eb0-81e4-4bfc-a302-90173b30bd1a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:27.297081 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-f0602eb0-81e4-4bfc-a302-90173b30bd1a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:27.432811 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-f0602eb0-81e4-4bfc-a302-90173b30bd1a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:27.440905 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-f0602eb0-81e4-4bfc-a302-90173b30bd1a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1368 microversion: 2.1 time: 0.161355 Aug 26 06:30:27.441489 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 640/1286] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:27 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:28.464300 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e44dcb51-28b8-4f30-8894-c169cbc16eb1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:28.465204 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-e44dcb51-28b8-4f30-8894-c169cbc16eb1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:28.467901 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=2 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:30:28.469222 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell0:SELECT=8 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:30:28.474657 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e44dcb51-28b8-4f30-8894-c169cbc16eb1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:28.476383 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e44dcb51-28b8-4f30-8894-c169cbc16eb1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:28.477078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e44dcb51-28b8-4f30-8894-c169cbc16eb1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:28.478029 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e44dcb51-28b8-4f30-8894-c169cbc16eb1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:28.478531 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e44dcb51-28b8-4f30-8894-c169cbc16eb1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:28.478992 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-e44dcb51-28b8-4f30-8894-c169cbc16eb1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:28.638757 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-e44dcb51-28b8-4f30-8894-c169cbc16eb1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:28.643960 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-f2c3cded-ccbd-4b26-a8f8-26ac31748504 req-1a9d0495-2da1-423f-bec8-d02c0c851f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e40e2d-94dd-457a-8aa3-4810a4c316c8", "name": "network-vif-plugged", "status": "completed", "tag": "f0fcf348-aeb7-46e5-a86a-c7349af6e732"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:30:28.656092 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e44dcb51-28b8-4f30-8894-c169cbc16eb1 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1368 microversion: 2.1 time: 0.197447 Aug 26 06:30:28.656912 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 647/1287] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:28 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:28.665203 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f2c3cded-ccbd-4b26-a8f8-26ac31748504 req-1a9d0495-2da1-423f-bec8-d02c0c851f13 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:28.679516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f2c3cded-ccbd-4b26-a8f8-26ac31748504 req-1a9d0495-2da1-423f-bec8-d02c0c851f13 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:28.679516 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-f2c3cded-ccbd-4b26-a8f8-26ac31748504 req-1a9d0495-2da1-423f-bec8-d02c0c851f13 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:28.685311 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-f2c3cded-ccbd-4b26-a8f8-26ac31748504 req-1a9d0495-2da1-423f-bec8-d02c0c851f13 service nova] Creating event network-vif-plugged:f0fcf348-aeb7-46e5-a86a-c7349af6e732 for instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 on hv-cinder-85391 Aug 26 06:30:28.691520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-f2c3cded-ccbd-4b26-a8f8-26ac31748504 req-1a9d0495-2da1-423f-bec8-d02c0c851f13 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051230 Aug 26 06:30:28.692247 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 641/1288] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:30:29.679619 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-1989b5ea-1f84-4984-8cd7-b95c7b0766b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:29.680404 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1989b5ea-1f84-4984-8cd7-b95c7b0766b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:29.691520 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1989b5ea-1f84-4984-8cd7-b95c7b0766b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:29.692009 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1989b5ea-1f84-4984-8cd7-b95c7b0766b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:29.692446 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1989b5ea-1f84-4984-8cd7-b95c7b0766b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:29.693148 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1989b5ea-1f84-4984-8cd7-b95c7b0766b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:29.693601 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1989b5ea-1f84-4984-8cd7-b95c7b0766b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:29.694117 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1989b5ea-1f84-4984-8cd7-b95c7b0766b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:29.840191 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-1989b5ea-1f84-4984-8cd7-b95c7b0766b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:29.849652 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-1989b5ea-1f84-4984-8cd7-b95c7b0766b8 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1368 microversion: 2.1 time: 0.175326 Aug 26 06:30:29.851077 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 648/1289] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:29 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:30.875616 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-aa3a03f8-31c7-45a1-b687-b63109f045ef tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:30.876281 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-aa3a03f8-31c7-45a1-b687-b63109f045ef tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:30.883576 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa3a03f8-31c7-45a1-b687-b63109f045ef tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:30.884062 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa3a03f8-31c7-45a1-b687-b63109f045ef tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:30.884504 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa3a03f8-31c7-45a1-b687-b63109f045ef tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:30.885211 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa3a03f8-31c7-45a1-b687-b63109f045ef tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:30.885674 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa3a03f8-31c7-45a1-b687-b63109f045ef tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:30.886102 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-aa3a03f8-31c7-45a1-b687-b63109f045ef tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:31.035532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-aa3a03f8-31c7-45a1-b687-b63109f045ef tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:30:31.043961 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-aa3a03f8-31c7-45a1-b687-b63109f045ef tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1558 microversion: 2.1 time: 0.174311 Aug 26 06:30:31.044551 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 642/1290] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:30:30 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:30:31.066867 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-ad9685c4-0dde-42b7-abc5-0b8496d362a0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:30:31.067482 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-ad9685c4-0dde-42b7-abc5-0b8496d362a0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:30:31.075085 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad9685c4-0dde-42b7-abc5-0b8496d362a0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:31.075572 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad9685c4-0dde-42b7-abc5-0b8496d362a0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:31.076000 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad9685c4-0dde-42b7-abc5-0b8496d362a0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:31.076708 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad9685c4-0dde-42b7-abc5-0b8496d362a0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:31.077147 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad9685c4-0dde-42b7-abc5-0b8496d362a0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:31.077565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-ad9685c4-0dde-42b7-abc5-0b8496d362a0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:31.166477 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-ad9685c4-0dde-42b7-abc5-0b8496d362a0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105438 Aug 26 06:30:31.167173 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 649/1291] 10.222.0.40 () {58 vars in 1275 bytes} [Fri Aug 26 06:30:31 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:30:32.596229 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-1401bb2e-f44d-424b-ba81-fa93255f25e6 req-72991f5e-637a-4eb2-8750-01222b4e9543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e40e2d-94dd-457a-8aa3-4810a4c316c8", "tag": "f0fcf348-aeb7-46e5-a86a-c7349af6e732"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:30:32.607918 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-1401bb2e-f44d-424b-ba81-fa93255f25e6 req-72991f5e-637a-4eb2-8750-01222b4e9543 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:30:32.608536 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-1401bb2e-f44d-424b-ba81-fa93255f25e6 req-72991f5e-637a-4eb2-8750-01222b4e9543 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:30:32.608978 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-1401bb2e-f44d-424b-ba81-fa93255f25e6 req-72991f5e-637a-4eb2-8750-01222b4e9543 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:30:32.622557 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-1401bb2e-f44d-424b-ba81-fa93255f25e6 req-72991f5e-637a-4eb2-8750-01222b4e9543 service nova] Creating event network-changed:f0fcf348-aeb7-46e5-a86a-c7349af6e732 for instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 on hv-cinder-85391 Aug 26 06:30:32.628267 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-1401bb2e-f44d-424b-ba81-fa93255f25e6 req-72991f5e-637a-4eb2-8750-01222b4e9543 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035634 Aug 26 06:30:32.632481 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 643/1292] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:31:02.511283 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:31:02.512041 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG dbcounter [-] [121343] Writing DB stats nova_cell1:SELECT=80 {{(pid=121343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:31:02.516208 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-b3cdd826-2c50-413c-8892-578d735a6156 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:02.516689 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-b3cdd826-2c50-413c-8892-578d735a6156 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:02.522986 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b3cdd826-2c50-413c-8892-578d735a6156 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:02.547799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b3cdd826-2c50-413c-8892-578d735a6156 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:02.547799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b3cdd826-2c50-413c-8892-578d735a6156 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:02.547799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b3cdd826-2c50-413c-8892-578d735a6156 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:02.547799 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b3cdd826-2c50-413c-8892-578d735a6156 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:02.548295 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-b3cdd826-2c50-413c-8892-578d735a6156 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:02.550130 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-b3cdd826-2c50-413c-8892-578d735a6156 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/ips" status: 200 len: 149 microversion: 2.1 time: 0.040293 Aug 26 06:31:02.550740 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 650/1293] 10.222.0.40 () {58 vars in 1248 bytes} [Fri Aug 26 06:31:02 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:31:04.462258 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=9 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:31:04.463040 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_cell1:SELECT=21 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:31:04.467650 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-0642663e-8ff2-4735-ac48-6e723563142e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb3c0849-e9d9-4f47-8106-b725f76313c8"}} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:31:04.470115 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-0642663e-8ff2-4735-ac48-6e723563142e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:04.478461 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0642663e-8ff2-4735-ac48-6e723563142e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:04.481998 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0642663e-8ff2-4735-ac48-6e723563142e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:04.481998 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0642663e-8ff2-4735-ac48-6e723563142e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:04.481998 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0642663e-8ff2-4735-ac48-6e723563142e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:04.481998 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0642663e-8ff2-4735-ac48-6e723563142e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:04.482437 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-0642663e-8ff2-4735-ac48-6e723563142e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:05.697769 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-0642663e-8ff2-4735-ac48-6e723563142e tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "POST /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.236722 Aug 26 06:31:05.698523 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 644/1294] 10.222.0.40 () {60 vars in 1323 bytes} [Fri Aug 26 06:31:04 2022] POST /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/os-volume_attachments => generated 194 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 06:31:14.422976 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f506231d-ea92-4e03-8c21-9b1e02d64e95 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:14.423535 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f506231d-ea92-4e03-8c21-9b1e02d64e95 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:14.432310 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f506231d-ea92-4e03-8c21-9b1e02d64e95 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:14.432792 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f506231d-ea92-4e03-8c21-9b1e02d64e95 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:14.433232 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f506231d-ea92-4e03-8c21-9b1e02d64e95 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:14.433924 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f506231d-ea92-4e03-8c21-9b1e02d64e95 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:14.434378 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f506231d-ea92-4e03-8c21-9b1e02d64e95 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:14.434855 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f506231d-ea92-4e03-8c21-9b1e02d64e95 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:14.518063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-f506231d-ea92-4e03-8c21-9b1e02d64e95 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lazy-loading 'services' on Instance uuid 03e40e2d-94dd-457a-8aa3-4810a4c316c8 {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:31:14.908592 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f506231d-ea92-4e03-8c21-9b1e02d64e95 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/os-volume_attachments/bb3c0849-e9d9-4f47-8106-b725f76313c8" status: 202 len: 0 microversion: 2.1 time: 0.489393 Aug 26 06:31:14.913497 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 651/1295] 10.222.0.40 () {58 vars in 1416 bytes} [Fri Aug 26 06:31:14 2022] DELETE /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/os-volume_attachments/bb3c0849-e9d9-4f47-8106-b725f76313c8 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:31:14.918912 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-1a917144-fed7-463c-a127-2179d17310ea tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:14.921264 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-1a917144-fed7-463c-a127-2179d17310ea tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:14.923860 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG dbcounter [-] [121344] Writing DB stats nova_api:SELECT=2 {{(pid=121344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 06:31:14.930011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1a917144-fed7-463c-a127-2179d17310ea tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:14.930491 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1a917144-fed7-463c-a127-2179d17310ea tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:14.930954 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1a917144-fed7-463c-a127-2179d17310ea tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:14.931647 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1a917144-fed7-463c-a127-2179d17310ea tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:14.932096 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1a917144-fed7-463c-a127-2179d17310ea tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:14.932520 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-1a917144-fed7-463c-a127-2179d17310ea tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:14.964076 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-1a917144-fed7-463c-a127-2179d17310ea tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049403 Aug 26 06:31:14.964646 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 645/1296] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:31:14 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:31:15.977666 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-1c9bb9e7-2e78-4409-aabf-aed85ed42c56 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:15.980078 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-1c9bb9e7-2e78-4409-aabf-aed85ed42c56 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:15.986414 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1c9bb9e7-2e78-4409-aabf-aed85ed42c56 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:15.986904 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1c9bb9e7-2e78-4409-aabf-aed85ed42c56 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:15.992158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1c9bb9e7-2e78-4409-aabf-aed85ed42c56 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:15.992158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1c9bb9e7-2e78-4409-aabf-aed85ed42c56 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:15.992158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1c9bb9e7-2e78-4409-aabf-aed85ed42c56 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:15.992158 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-1c9bb9e7-2e78-4409-aabf-aed85ed42c56 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:16.019871 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-1c9bb9e7-2e78-4409-aabf-aed85ed42c56 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047153 Aug 26 06:31:16.020423 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 652/1297] 10.222.0.40 () {58 vars in 1302 bytes} [Fri Aug 26 06:31:15 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 06:31:16.090266 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-ebacff6e-d3d1-4f25-801d-cf3a474addcc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:16.090843 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ebacff6e-d3d1-4f25-801d-cf3a474addcc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:16.097395 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebacff6e-d3d1-4f25-801d-cf3a474addcc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:16.097875 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebacff6e-d3d1-4f25-801d-cf3a474addcc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:16.098336 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebacff6e-d3d1-4f25-801d-cf3a474addcc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:16.099079 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebacff6e-d3d1-4f25-801d-cf3a474addcc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:16.099532 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebacff6e-d3d1-4f25-801d-cf3a474addcc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:16.099952 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-ebacff6e-d3d1-4f25-801d-cf3a474addcc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:16.129156 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-ebacff6e-d3d1-4f25-801d-cf3a474addcc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Going to try to terminate instance {{(pid=121344) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 06:31:16.560496 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-ebacff6e-d3d1-4f25-801d-cf3a474addcc tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 204 len: 0 microversion: 2.1 time: 0.474039 Aug 26 06:31:16.561082 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 646/1298] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:31:16 2022] DELETE /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 06:31:16.569465 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-4ec68147-5e62-46c9-be52-ff11946d904f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:16.570067 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-4ec68147-5e62-46c9-be52-ff11946d904f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:16.576172 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ec68147-5e62-46c9-be52-ff11946d904f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:16.581597 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ec68147-5e62-46c9-be52-ff11946d904f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:16.581597 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ec68147-5e62-46c9-be52-ff11946d904f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:16.581597 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ec68147-5e62-46c9-be52-ff11946d904f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:16.581597 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ec68147-5e62-46c9-be52-ff11946d904f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:16.582005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-4ec68147-5e62-46c9-be52-ff11946d904f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:16.714873 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-4ec68147-5e62-46c9-be52-ff11946d904f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:31:16.722637 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-4ec68147-5e62-46c9-be52-ff11946d904f tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1682 microversion: 2.1 time: 0.157008 Aug 26 06:31:16.723212 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 653/1299] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:31:16 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:31:17.745558 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-9a772c0e-0dc7-4d1b-8f7c-910c311fe37a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:17.746214 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-9a772c0e-0dc7-4d1b-8f7c-910c311fe37a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:17.752801 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9a772c0e-0dc7-4d1b-8f7c-910c311fe37a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:17.753285 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9a772c0e-0dc7-4d1b-8f7c-910c311fe37a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:17.753726 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9a772c0e-0dc7-4d1b-8f7c-910c311fe37a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:17.754429 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9a772c0e-0dc7-4d1b-8f7c-910c311fe37a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:17.754922 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9a772c0e-0dc7-4d1b-8f7c-910c311fe37a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:17.755529 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-9a772c0e-0dc7-4d1b-8f7c-910c311fe37a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:17.894529 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.policy [None req-9a772c0e-0dc7-4d1b-8f7c-910c311fe37a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121344) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:31:17.903515 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-9a772c0e-0dc7-4d1b-8f7c-910c311fe37a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1682 microversion: 2.1 time: 0.162188 Aug 26 06:31:17.904085 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 647/1300] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:31:17 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:31:18.929307 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c0d12965-3ad3-4114-a0a9-d93ce403b627 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:18.929915 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c0d12965-3ad3-4114-a0a9-d93ce403b627 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:18.936453 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0d12965-3ad3-4114-a0a9-d93ce403b627 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:18.936933 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0d12965-3ad3-4114-a0a9-d93ce403b627 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:18.937365 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0d12965-3ad3-4114-a0a9-d93ce403b627 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:18.938053 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0d12965-3ad3-4114-a0a9-d93ce403b627 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:18.938497 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0d12965-3ad3-4114-a0a9-d93ce403b627 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:18.938944 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c0d12965-3ad3-4114-a0a9-d93ce403b627 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:19.008726 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-c0d12965-3ad3-4114-a0a9-d93ce403b627 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:31:19.016511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c0d12965-3ad3-4114-a0a9-d93ce403b627 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1614 microversion: 2.1 time: 0.092308 Aug 26 06:31:19.017211 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 654/1301] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:31:18 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:31:19.165942 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [req-a5b11543-e25d-4421-a3ee-153b08c54b5f req-2d23e3be-a922-4218-b4f8-93dc61eb3484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e40e2d-94dd-457a-8aa3-4810a4c316c8", "name": "network-vif-deleted", "tag": "f0fcf348-aeb7-46e5-a86a-c7349af6e732"}]} {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 06:31:19.178878 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a5b11543-e25d-4421-a3ee-153b08c54b5f req-2d23e3be-a922-4218-b4f8-93dc61eb3484 service nova] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:19.179741 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a5b11543-e25d-4421-a3ee-153b08c54b5f req-2d23e3be-a922-4218-b4f8-93dc61eb3484 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:19.180251 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [req-a5b11543-e25d-4421-a3ee-153b08c54b5f req-2d23e3be-a922-4218-b4f8-93dc61eb3484 service nova] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:19.191525 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.compute.server_external_events [req-a5b11543-e25d-4421-a3ee-153b08c54b5f req-2d23e3be-a922-4218-b4f8-93dc61eb3484 service nova] Creating event network-vif-deleted:f0fcf348-aeb7-46e5-a86a-c7349af6e732 for instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 on hv-cinder-85391 Aug 26 06:31:19.197306 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [req-a5b11543-e25d-4421-a3ee-153b08c54b5f req-2d23e3be-a922-4218-b4f8-93dc61eb3484 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035068 Aug 26 06:31:19.198001 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 648/1302] 10.222.0.40 () {64 vars in 1317 bytes} [Fri Aug 26 06:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 06:31:20.039218 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:20.039943 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:20.049819 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:20.050319 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:20.050797 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:20.052995 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:20.053491 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:20.053932 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:20.089511 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:20.089988 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:20.090417 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:20.090897 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.objects.instance [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lazy-loading 'fault' on Instance uuid 03e40e2d-94dd-457a-8aa3-4810a4c316c8 {{(pid=121343) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 06:31:20.138220 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.policy [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38f279301f8c4c76945d361f19b686ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c070cba92de641518c86248b1e27daea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121343) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 06:31:20.146338 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-a6860a6b-5cf2-4b0f-9611-890f37dfeeae tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 200 len: 1332 microversion: 2.1 time: 0.112065 Aug 26 06:31:20.147055 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 655/1303] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:31:20 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 06:31:21.169677 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:21.170385 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:21.177477 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:21.177976 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:21.178420 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:21.179431 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:21.179890 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:21.180349 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:21.195627 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 HTTP/1.1 Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:31:21.197292 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:21.199164 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '03e40e2d-94dd-457a-8aa3-4810a4c316c8'} Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:31:21.200042 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:21.201439 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:21.202800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:31:21.202800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-83f0209b-9d4c-448f-93bd-e96c341185c0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 404 len: 111 microversion: 2.1 time: 0.033952 Aug 26 06:31:21.202800 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 649/1304] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:31:21 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 06:31:21.208292 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-e05b0af2-c8d1-4c20-afaa-9a7b13550726 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '.version_select at 0x7f2f092a7040>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:21.372818 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-e05b0af2-c8d1-4c20-afaa-9a7b13550726 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084809159" status: 202 len: 0 microversion: 2.1 time: 0.168284 Aug 26 06:31:21.373392 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 656/1305] 10.222.0.40 () {58 vars in 1221 bytes} [Fri Aug 26 06:31:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084809159 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 06:31:23.971082 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:23.971910 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:23.979107 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:23.979587 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:23.980021 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:23.980715 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:23.981162 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:23.981584 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:23.996211 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: DELETE /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 HTTP/1.1 Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:31:23.997788 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:23.999604 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '03e40e2d-94dd-457a-8aa3-4810a4c316c8'} Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:31:24.000862 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:24.006238 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:24.007962 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:31:24.007962 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-e22f00e0-d252-42f8-874b-66bec42074bd tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 404 len: 111 microversion: 2.1 time: 0.031962 Aug 26 06:31:24.007962 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 650/1306] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:31:23 2022] DELETE /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:31:24.008298 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:24.008896 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 03e40e2d-94dd-457a-8aa3-4810a4c316c8] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:24.015680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:24.016156 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:24.016588 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:24.017270 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:24.017751 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:24.018165 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:24.031409 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 HTTP/1.1 Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:31:24.033118 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:24.034824 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': '03e40e2d-94dd-457a-8aa3-4810a4c316c8'} Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:31:24.035713 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. Aug 26 06:31:24.038005 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:24.039240 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance 03e40e2d-94dd-457a-8aa3-4810a4c316c8 could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:31:24.039240 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-3a49b4c8-fe4d-49ac-855e-db0d95766bd0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8" status: 404 len: 111 microversion: 2.1 time: 0.030729 Aug 26 06:31:24.039240 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 657/1307] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:31:24 2022] GET /compute/v2.1/servers/03e40e2d-94dd-457a-8aa3-4810a4c316c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:31:25.557084 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:25.557625 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:25.568934 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:25.569422 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:25.569855 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:25.570555 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:25.571046 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:25.571469 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:25.585759 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: DELETE /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 HTTP/1.1 Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:31:25.587344 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:31:25.589011 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1'} Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:31:25.589887 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:31:25.591255 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.592577 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:31:25.592577 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-dc63d368-5021-41cd-bc7b-a1ee25b9d482 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 404 len: 111 microversion: 2.1 time: 0.036819 Aug 26 06:31:25.592577 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 651/1308] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:31:25 2022] DELETE /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:31:25.597415 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:25.598030 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:25.605242 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:25.605725 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:25.606167 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:25.606929 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:25.607382 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:25.607804 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:25.621805 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 HTTP/1.1 Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:31:25.623347 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:31:25.625063 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1'} Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:31:25.626017 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. Aug 26 06:31:25.627565 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.629058 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:31:25.629058 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-c06dc89c-8a0b-4bb0-9ba5-8e2864ea8120 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1" status: 404 len: 111 microversion: 2.1 time: 0.031213 Aug 26 06:31:25.629058 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 658/1309] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:31:25 2022] GET /compute/v2.1/servers/b71e98b7-8a1d-4d0b-a2db-4ad91d6893a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:31:25.634865 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:25.635358 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:25.641285 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:25.641952 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:25.642381 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:25.643090 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:25.643592 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:25.644018 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:25.657851 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: DELETE /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe HTTP/1.1 Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:31:25.659535 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:31:25.661877 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': 'c20b2603-fcec-4d01-bc64-d8dea988ccfe'} Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:31:25.663224 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:31:25.665006 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.666583 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:31:25.666583 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-bebb2e87-79a8-4860-b613-88a81cd41c2a tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 404 len: 111 microversion: 2.1 time: 0.030367 Aug 26 06:31:25.666583 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 652/1310] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:31:25 2022] DELETE /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:31:25.670066 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:25.670678 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: c20b2603-fcec-4d01-bc64-d8dea988ccfe] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:25.677315 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:25.677852 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:25.678288 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:25.679001 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:25.679717 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:25.680141 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:25.693693 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe HTTP/1.1 Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:31:25.695247 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:31:25.696973 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': 'c20b2603-fcec-4d01-bc64-d8dea988ccfe'} Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:31:25.698093 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. Aug 26 06:31:25.699734 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:25.701550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance c20b2603-fcec-4d01-bc64-d8dea988ccfe could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:31:25.701550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-9857aaf6-c606-4197-8dae-35c68d643b47 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe" status: 404 len: 111 microversion: 2.1 time: 0.030364 Aug 26 06:31:25.701550 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 659/1311] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:31:25 2022] GET /compute/v2.1/servers/c20b2603-fcec-4d01-bc64-d8dea988ccfe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:31:27.092980 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:27.093669 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.compute.api [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121344) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:27.101901 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:27.102380 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:27.102864 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:27.103559 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:27.104010 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:27.104440 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG oslo_concurrency.lockutils [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:27.118333 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.wsgi [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: request: DELETE /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a HTTP/1.1 Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept: application/json Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Accept-Encoding: identity Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Connection: close Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Length: 0 Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Content-Type: application/json Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Host: 10.222.0.40 Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: Openstack-System-Scope: None Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: User-Agent: python-urllib3/1.26.11 Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Id: None Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Domain-Name: None Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Identity-Status: Confirmed Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Is-Admin-Project: True Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Id: default Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Domain-Name: Default Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Role: member,reader Aug 26 06:31:27.124230 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Roles: member,reader Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Id: default Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Domain-Name: Default Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: method: > Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: exception: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:31:27.126023 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: action_args: {'id': '9ae98859-f32e-4f5b-b796-a330a860f02a'} Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: {{(pid=121344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:31:27.127057 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:31:27.128689 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: ERROR nova.api.openstack.wsgi Aug 26 06:31:27.131018 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: DEBUG nova.api.openstack.wsgi [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. {{(pid=121344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:31:27.131018 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: INFO nova.api.openstack.requestlog [None req-2c057742-0629-4482-9171-9364bf15a0cf tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 404 len: 111 microversion: 2.1 time: 0.033861 Aug 26 06:31:27.131018 dv-cinder-853910-3-iscsi devstack@n-api.service[121344]: [pid: 121344|app: 0|req: 653/1312] 10.222.0.40 () {58 vars in 1239 bytes} [Fri Aug 26 06:31:27 2022] DELETE /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 06:31:27.131721 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Calling method '>' {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 06:31:27.132335 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.compute.api [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] [instance: 9ae98859-f32e-4f5b-b796-a330a860f02a] Fetching instance by UUID {{(pid=121343) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 06:31:27.138914 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:27.139395 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:27.139831 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:27.142289 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Acquiring lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 06:31:27.142289 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 06:31:27.142289 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG oslo_concurrency.lockutils [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Lock "fcc5be55-ca87-448b-b1ff-b5f0f867fd3d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 06:31:27.157428 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.wsgi [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] HTTP exception thrown: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Request method failure captured: Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: request: GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a HTTP/1.1 Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept: application/json Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Accept-Encoding: identity Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Connection: close Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Length: 0 Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Content-Type: application/json Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Host: 10.222.0.40 Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: Openstack-System-Scope: None Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: User-Agent: python-urllib3/1.26.11 Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Auth-Token: gAAAAABjCGeR2RRRbD4Y1WglNu1FJUR98bK00YldVFZEVpSFrs7GLxFpAqFKrG_PHzSU6AWoLsPLK95B4PjZ_-a4ky3veQqtNnFoRDL7F4kaFEJBwSWf0rNpo0jp-a-sDs6OV4qoQMXBzFJzdCsyrfQAXJwyQw0YGzHhveuOu9Z1vfsFvuiIldA Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Id: None Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Domain-Name: None Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Identity-Status: Confirmed Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Is-Admin-Project: True Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Id: default Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Domain-Name: Default Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Project-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Role: member,reader Aug 26 06:31:27.159466 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Roles: member,reader Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c070cba92de641518c86248b1e27daea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c070cba92de641518c86248b1e27daea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c070cba92de641518c86248b1e27daea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Id: c070cba92de641518c86248b1e27daea Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1915838625 Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Id: default Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Domain-Name: Default Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Id: 38f279301f8c4c76945d361f19b686ac Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: X-User-Name: tempest-AttachVolumeNegativeTest-1915838625-project Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: method: > Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: exception: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:31:27.161015 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: action_args: {'id': '9ae98859-f32e-4f5b-b796-a330a860f02a'} Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: {{(pid=121343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 06:31:27.161998 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. Aug 26 06:31:27.163680 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: ERROR nova.api.openstack.wsgi Aug 26 06:31:27.165570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: DEBUG nova.api.openstack.wsgi [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] Returning 404 to user: Instance 9ae98859-f32e-4f5b-b796-a330a860f02a could not be found. {{(pid=121343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 06:31:27.165570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: INFO nova.api.openstack.requestlog [None req-f99316f3-7d55-4a5f-9380-4dbb142575e0 tempest-AttachVolumeNegativeTest-1915838625 tempest-AttachVolumeNegativeTest-1915838625-project] 10.222.0.40 "GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a" status: 404 len: 111 microversion: 2.1 time: 0.033593 Aug 26 06:31:27.165570 dv-cinder-853910-3-iscsi devstack@n-api.service[121343]: [pid: 121343|app: 0|req: 660/1313] 10.222.0.40 () {58 vars in 1236 bytes} [Fri Aug 26 06:31:27 2022] GET /compute/v2.1/servers/9ae98859-f32e-4f5b-b796-a330a860f02a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)